Sep 23 12:27:30 devstack cinder-volume[75057]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 12:27:30 devstack cinder-volume[75057]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 12:27:30 devstack cinder-volume[75057]: we strongly recommend against using it for new projects. Sep 23 12:27:30 devstack cinder-volume[75057]: If you are already using Eventlet, we recommend migrating to a different Sep 23 12:27:30 devstack cinder-volume[75057]: framework. For more detail see Sep 23 12:27:30 devstack cinder-volume[75057]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 12:27:30 devstack cinder-volume[75057]: import eventlet # noqa Sep 23 12:27:32 devstack cinder-volume[75057]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75057) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 12:27:32 devstack cinder-volume[75057]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75057) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 12:27:32 devstack cinder-volume[75057]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75057) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 12:27:33 devstack cinder-volume[75057]: INFO dbcounter [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Registered counter for database cinder Sep 23 12:27:34 devstack cinder-volume[75057]: DEBUG oslo_db.sqlalchemy.engines [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75057) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 12:27:34 devstack cinder-volume[75057]: DEBUG dbcounter [-] [75057] Writer thread running {{(pid=75057) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 12:27:34 devstack cinder-volume[75057]: INFO cinder.rpc [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 12:27:34 devstack cinder-volume[75057]: INFO cinder.rpc [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 12:27:34 devstack cinder-volume[75057]: DEBUG oslo_db.sqlalchemy.engines [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75057) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 12:27:34 devstack cinder-volume[75057]: INFO cinder.volume.manager [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Determined volume DB was empty at startup. Sep 23 12:27:34 devstack cinder-volume[75057]: DEBUG cinder.volume.manager [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75057) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 12:27:34 devstack cinder-volume[75057]: INFO cinder.volume.manager [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 23 12:27:34 devstack cinder-volume[75057]: WARNING stevedore.named [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 12:27:34 devstack cinder-volume[75057]: WARNING castellan.key_manager [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 12:27:34 devstack cinder-volume[75057]: WARNING cinder.keymgr.conf_key_mgr [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 12:27:34 devstack cinder-volume[75057]: DEBUG cinder.volume.drivers.lvm [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75057) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 23 12:27:34 devstack cinder-volume[75057]: DEBUG oslo_concurrency.processutils [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_concurrency.processutils [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] CMD "cinder-rtstool verify" returned: 0 in 0.496s {{(pid=75057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_db.sqlalchemy.engines [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75057) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 12:27:35 devstack cinder-volume[75057]: INFO cinder.rpc [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 23 12:27:35 devstack cinder-volume[75057]: INFO cinder.rpc [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 23 12:27:35 devstack cinder-volume[75057]: WARNING stevedore.named [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 12:27:35 devstack cinder-volume[75057]: WARNING castellan.key_manager [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 12:27:35 devstack cinder-volume[75057]: INFO cinder.volume.manager [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_db.sqlalchemy.engines [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75057) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 12:27:35 devstack cinder-volume[75057]: INFO oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Starting 1 workers Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Started child 75212 {{(pid=75057) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Full set of CONF: {{(pid=75057) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] ******************************************************************************** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Configuration options gathered from: {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] ================================================================================ {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] allow_availability_zone_fallback = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] allow_compression_on_image_upload = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] allowed_direct_url_schemes = [] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] api_rate_limit = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] auth_strategy = keystone {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] az_cache_duration = 3600 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_availability_zone = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_host = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_name = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_stats_polling_interval = 60 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backup_api_class = cinder.backup.api.API {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75212]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backup_name_template = backup-%s {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backup_use_same_host = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backup_use_temp_snapshot = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] chap_password = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] chap_username = {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cinder_internal_tenant_project_id = 7165f7f98a5b4b36814351da4aee1df5 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cinder_internal_tenant_user_id = d01111c19d564a78acd6e2c7b30d58af {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cloned_volume_same_az = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cluster = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] compression_format = gzip {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] compute_api_class = cinder.compute.nova.API {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] config_dir = [] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] config_source = [] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] control_exchange = openstack {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] debug = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] default_availability_zone = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] default_group_type = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] default_volume_type = lvmdriver-1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] disk_geometry = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] driver_client_cert = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] driver_client_cert_key = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] driver_data_namespace = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] driver_ssl_cert_path = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] driver_ssl_cert_verify = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] driver_use_ssl = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] enable_force_upload = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] enable_new_services = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] enable_unsupported_driver = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] enabled_backends = ['lvmdriver-1'] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] enforce_multipath_for_image_xfer = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] filter_function = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance_api_insecure = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance_api_servers = ['http://192.168.122.149/image'] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance_api_ssl_compression = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance_ca_certificates_file = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance_catalog_info = image:glance:publicURL {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance_certfile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance_keyfile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance_num_retries = 3 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance_request_timeout = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] goodness_function = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] graceful_shutdown_timeout = 5 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] group_api_class = cinder.group.api.API {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] host = devstack {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] image_compress_on_upload = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] image_conversion_address_space_limit = 1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] image_conversion_cpu_limit = 60 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] image_conversion_disable = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] image_introspection_address_space_limit = 1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] image_introspection_cpu_limit = 60 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] image_upload_use_cinder_backend = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] image_upload_use_internal_tenant = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] image_volume_cache_enabled = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] image_volume_cache_max_count = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] image_volume_cache_max_size_gb = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] init_host_max_objects_retrieval = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] instance_format = [instance: %(uuid)s] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] iscsi_target_flags = {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] iscsi_write_cache = on {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] iser_helper = tgtadm {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] iser_ip_address = 192.168.122.149 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] iser_port = 3260 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] log_color = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] log_config_append = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] log_dir = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] log_file = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] log_options = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] log_rotate_interval = 1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] log_rotate_interval_type = days {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] log_rotation_type = none {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] max_age = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] max_logfile_count = 30 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] max_logfile_size_mb = 200 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] max_over_subscription_ratio = 20.0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] message_reap_interval = 86400 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] message_ttl = 2592000 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] migration_create_volume_timeout_secs = 300 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] monkey_patch = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] monkey_patch_modules = [] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] my_ip = 192.168.122.149 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] no_snapshot_gb_quota = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] num_iser_scan_tries = 3 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] num_shell_tries = 3 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] num_volume_device_scan_tries = 3 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] nvmeof_conn_info_version = 1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] nvmet_ns_id = 10 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] nvmet_port_id = 1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] osapi_max_limit = 1000 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] osapi_volume_ext_list = [] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] osapi_volume_listen = 0.0.0.0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] osapi_volume_listen_port = 8776 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] osapi_volume_use_ssl = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] osapi_volume_workers = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] per_volume_size_limit = -1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] periodic_fuzzy_delay = 60 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] periodic_interval = 60 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] project_id_regex = [0-9a-f\-]+ {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] public_endpoint = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] publish_errors = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] quota_backup_gigabytes = 1000 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] quota_backups = 10 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] quota_gigabytes = 1000 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] quota_groups = 10 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] quota_snapshots = 10 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] quota_volumes = 10 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] rate_limit_burst = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] rate_limit_except_level = CRITICAL {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] rate_limit_interval = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] reinit_driver_count = 3 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] replication_device = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] report_discard_supported = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] report_interval = 120 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] reservation_clean_interval = 86400 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] reservation_expire = 86400 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] reserved_image_namespaces = [] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] reserved_percentage = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] rpc_response_timeout = 120 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] run_external_periodic_tasks = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] scst_target_driver = iscsi {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] scst_target_iqn_name = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] service_down_time = 720 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] shell_completion = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] snapshot_name_template = snapshot-%s {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] snapshot_same_host = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] split_loggers = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] state_path = /opt/stack/data/cinder {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] storage_availability_zone = nova {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] storage_protocol = iSCSI {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] syslog_log_facility = LOG_USER {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] target_helper = lioadm {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] target_ip_address = 192.168.122.149 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] target_port = 3260 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] target_protocol = iscsi {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] target_secondary_ip_addresses = [] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] trace_flags = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] transfer_api_class = cinder.transfer.api.API {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] transport_url = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] until_refresh = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] use_chap_auth = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] use_default_quota_class = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] use_journal = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] use_json = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] use_multipath_for_image_xfer = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] use_stderr = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] use_syslog = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] verify_glance_signatures = enabled {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] volume_api_class = cinder.volume.api.API {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] volume_backend_name = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] volume_clear = zero {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] volume_clear_ionice = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] volume_clear_size = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] volume_copy_bps_limit = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] volume_dd_blocksize = 1M {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] volume_name_template = volume-%s {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] volume_service_inithost_offload = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] volume_usage_audit_period = month {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] zoning_mode = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_concurrency.disable_process_locking = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.auth_section = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.auth_type = password {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.auth_version = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.cache = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.certfile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.delay_auth_decision = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.http_connect_timeout = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.include_service_catalog = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.insecure = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.interface = public {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.keyfile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.memcache_password = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.memcache_username = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.region_name = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.service_token_roles_required = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.service_type = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.token_cache_time = 300 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.149/identity {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.backend = dogpile.cache.null {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.backend_argument = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.backend_expiration_time = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.config_prefix = cache.oslo {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.debug_cache_backend = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.enable_retry_client = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.enable_socket_keepalive = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.enabled = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.expiration_time = 600 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.hashclient_retry_attempts = 2 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.memcache_dead_retry = 300 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.memcache_pool_maxsize = 10 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.memcache_sasl_enabled = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.password = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.proxies = [] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.redis_db = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.redis_sentinel_service_name = mymaster {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.redis_server = localhost:6379 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.retry_attempts = 2 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.retry_delay = 0.0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.socket_keepalive_count = 1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.socket_keepalive_idle = 1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.socket_keepalive_interval = 1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.socket_timeout = 1.0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.tls_allowed_ciphers = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.tls_cafile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.tls_certfile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.tls_enabled = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.tls_keyfile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cache.username = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] coordination.backend_url = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.asyncio_connection = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75212]: INFO cinder.volume.manager [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.asyncio_slave_connection = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.backend = sqlalchemy {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.connection = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.connection_debug = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.connection_parameters = {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.connection_recycle_time = 3600 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.connection_trace = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.db_inc_retry_interval = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.db_max_retries = 20 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.db_max_retry_interval = 10 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.db_retry_interval = 1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.max_overflow = 50 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.max_pool_size = 5 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.max_retries = 10 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.mysql_wsrep_sync_wait = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.pool_timeout = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.retry_interval = 10 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.slave_connection = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.sqlite_synchronous = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.synchronous_reader = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] database.use_db_reconnect = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_tracing.insecure = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] profiler.connection_string = messaging:// {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] profiler.enabled = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] profiler.es_doc_type = notification {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] profiler.es_scroll_size = 10000 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] profiler.es_scroll_time = 2m {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] profiler.filter_error_trace = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] profiler.hmac_keys = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] profiler.sentinel_service_name = mymaster {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] profiler.socket_timeout = 0.1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] profiler.trace_requests = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] profiler.trace_sqlalchemy = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] profiler_jaeger.process_tags = {} {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] profiler_jaeger.service_name_prefix = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] profiler_otlp.service_name_prefix = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_policy.enforce_new_defaults = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_policy.policy_default_rule = default {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_policy.policy_file = policy.yaml {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:35 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_policy.remote_timeout = 60.0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] privsep_osbrick.group = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] privsep_osbrick.helper_command = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] privsep_osbrick.user = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cinder_sys_admin.group = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cinder_sys_admin.helper_command = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] cinder_sys_admin.user = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] service_user.auth_section = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] service_user.auth_type = password {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] service_user.cafile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] service_user.certfile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] service_user.collect_timing = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] service_user.insecure = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] service_user.keyfile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] service_user.send_service_user_token = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] service_user.split_loggers = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] service_user.timeout = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] service_user.tls_ciphers = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] service_user.tls_min_version = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance.auth_section = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance.auth_type = password {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance.certfile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance.collect_timing = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance.insecure = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance.keyfile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance.region_name = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance.split_loggers = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance.timeout = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance.tls_ciphers = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] glance.tls_min_version = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.backend_availability_zone = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.chap_password = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.chap_username = {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.disk_geometry = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.driver_client_cert = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.driver_client_cert_key = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.driver_data_namespace = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.driver_use_ssl = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.enable_unsupported_driver = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.extra_capabilities = {} {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.filter_function = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.goodness_function = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.iscsi_target_flags = {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.iscsi_write_cache = on {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.iser_helper = tgtadm {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.iser_ip_address = 192.168.122.149 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.iser_port = 3260 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.lvm_mirrors = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.lvm_share_target = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.lvm_type = auto {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.num_shell_tries = 3 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.nvmet_port_id = 1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.replication_device = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.report_discard_supported = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.reserved_percentage = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.scst_target_driver = iscsi {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.scst_target_iqn_name = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.storage_protocol = iSCSI {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.target_helper = tgtadm {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.target_ip_address = 192.168.122.149 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.target_port = 3260 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.target_protocol = iscsi {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.trace_flags = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.unique_fqdn_network = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.use_chap_auth = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.volume_backend_name = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.volume_clear = zero {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.volume_clear_ionice = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.volume_clear_size = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.volume_group = cinder-volumes {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_reports.file_event_handler = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_reports.log_dir = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.backend_availability_zone = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.backend_host = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.chap_password = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.chap_username = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.chiscsi_conf = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.disk_geometry = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.driver_client_cert = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.driver_data_namespace = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.driver_use_ssl = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.extra_capabilities = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.filter_function = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.goodness_function = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.iser_helper = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.iser_ip_address = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack sudo[75216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.iser_port = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.iser_target_prefix = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.lvm_conf_file = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.lvm_mirrors = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack sudo[75216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.lvm_share_target = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.lvm_type = auto {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.num_shell_tries = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.nvmet_port_id = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.replication_device = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.report_discard_supported = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.reserved_percentage = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.scst_target_driver = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.storage_protocol = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.target_helper = lioadm {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.target_ip_address = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.target_port = 3260 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.target_protocol = iscsi {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.trace_flags = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.use_chap_auth = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.volume_clear = zero {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.volume_clear_size = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] lvmdriver-1.volumes_dir = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.ssl = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.ssl_version = {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_notifications.driver = [] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_notifications.retry = -1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] oslo_messaging_notifications.transport_url = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] key_manager.fixed_key = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican.barbican_api_version = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican.barbican_endpoint = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican.barbican_endpoint_type = public {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican.barbican_region_name = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican.cafile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican.certfile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican.collect_timing = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican.insecure = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican.keyfile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican.number_of_retries = 60 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican.retry_delay = 1 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican.send_service_user_token = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican.split_loggers = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican.timeout = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican.tls_ciphers = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican.tls_min_version = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican.verify_ssl = True {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican.verify_ssl_path = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican_service_user.auth_section = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican_service_user.auth_type = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican_service_user.cafile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican_service_user.certfile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican_service_user.collect_timing = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican_service_user.insecure = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican_service_user.keyfile = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican_service_user.split_loggers = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican_service_user.timeout = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican_service_user.tls_ciphers = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] barbican_service_user.tls_min_version = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] vault.approle_role_id = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] vault.approle_secret_id = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] vault.auth_method = approle {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] vault.auth_path = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] vault.kv_mountpoint = secret {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] vault.kv_path = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] vault.kv_version = 2 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] vault.namespace = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] vault.root_token_id = **** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] vault.ssl_ca_crt_file = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] vault.timeout = 60.0 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] vault.token_file = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] vault.token_role = None {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] vault.use_ssl = False {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:27:35 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] ******************************************************************************** {{(pid=75057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 12:27:35 devstack sudo[75216]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:35 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:35 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:36 devstack sudo[75228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 12:27:36 devstack sudo[75228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:36 devstack sudo[75228]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:36 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.275s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:36 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:27:36 devstack cinder-volume[75212]: INFO cinder.brick.local_dev.lvm [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 23 12:27:36 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:36 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:36 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:36 devstack sudo[75387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 12:27:36 devstack sudo[75387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:36 devstack sudo[75387]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:36 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:36 devstack cinder-volume[75212]: DEBUG cinder.brick.local_dev.lvm [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75212) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 23 12:27:36 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:36 devstack sudo[75473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 12:27:36 devstack sudo[75473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:37 devstack sudo[75473]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:37 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.519s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:37 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:37 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:37 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:37 devstack sudo[75675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 12:27:37 devstack sudo[75675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:37 devstack sudo[75675]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:37 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:37 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:37 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:37 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:37 devstack sudo[75751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 23 12:27:37 devstack sudo[75751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:37 devstack sudo[75751]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:37 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.316s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:37 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:37 devstack sudo[75830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 12:27:37 devstack sudo[75830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:37 devstack sudo[75830]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:37 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:37 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:38 devstack sudo[75838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 12:27:38 devstack sudo[75838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:38 devstack sudo[75838]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:38 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.340s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:38 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:38 devstack sudo[75916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 12:27:38 devstack sudo[75916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:38 devstack sudo[75916]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:38 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:38 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:38 devstack sudo[75925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 12:27:38 devstack sudo[75925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:38 devstack sudo[75925]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:38 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.332s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:38 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:38 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:38 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:38 devstack sudo[76009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 12:27:38 devstack sudo[76009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:39 devstack sudo[76009]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:39 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:39 devstack cinder-volume[75212]: INFO cinder.volume.drivers.lvm [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 23 12:27:39 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:39 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:39 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:39 devstack sudo[76019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 12:27:39 devstack sudo[76019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:39 devstack sudo[76019]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:39 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:39 devstack cinder-volume[75212]: DEBUG cinder.volume.drivers.lvm [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Updating volume stats {{(pid=75212) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 12:27:39 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:39 devstack sudo[76022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 12:27:39 devstack sudo[76022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:39 devstack sudo[76022]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:39 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:39 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:39 devstack sudo[76025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 12:27:39 devstack sudo[76025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:40 devstack sudo[76025]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:40 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:40 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:40 devstack sudo[76029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 12:27:40 devstack sudo[76029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:40 devstack sudo[76029]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:40 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:40 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:40 devstack sudo[76032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 12:27:40 devstack sudo[76032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:40 devstack sudo[76032]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:40 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:40 devstack cinder-volume[75212]: INFO cinder.volume.driver [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Driver hasn't implemented _init_vendor_properties() Sep 23 12:27:40 devstack cinder-volume[75212]: DEBUG cinder.volume.driver [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75212) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 12:27:40 devstack cinder-volume[75212]: DEBUG oslo_db.sqlalchemy.engines [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75212) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 12:27:40 devstack cinder-volume[75212]: DEBUG dbcounter [-] [75212] Writer thread running {{(pid=75212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 12:27:40 devstack cinder-volume[75212]: DEBUG cinder.db.api [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Building query based on filter {{(pid=75212) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 23 12:27:40 devstack cinder-volume[75212]: DEBUG cinder.image.image_utils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75212) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 12:27:40 devstack cinder-volume[75212]: INFO cinder.keymgr.migration [None req-3af0e651-ebd6-46d6-ac1f-d183fb6f4434 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 12:27:40 devstack cinder-volume[75212]: DEBUG cinder.volume.drivers.lvm [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Updating volume stats {{(pid=75212) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 12:27:40 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:40 devstack sudo[76036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 12:27:40 devstack sudo[76036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:41 devstack sudo[76036]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:41 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:41 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:41 devstack sudo[76042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 12:27:41 devstack sudo[76042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:41 devstack sudo[76042]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:41 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:41 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:41 devstack sudo[76046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 12:27:41 devstack sudo[76046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:41 devstack sudo[76046]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:41 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:41 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:41 devstack sudo[76052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 12:27:41 devstack sudo[76052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:41 devstack sudo[76052]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:41 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:41 devstack cinder-volume[75212]: DEBUG cinder.manager [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Notifying Schedulers of capabilities ... {{(pid=75212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:27:41 devstack cinder-volume[75212]: INFO cinder.volume.manager [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Driver initialization completed successfully. Sep 23 12:27:41 devstack cinder-volume[75212]: INFO cinder.manager [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Initiating service 2 cleanup Sep 23 12:27:41 devstack cinder-volume[75212]: INFO cinder.manager [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Service 2 cleanup completed. Sep 23 12:27:41 devstack cinder-volume[75212]: DEBUG cinder.service [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Creating RPC server for service cinder-volume {{(pid=75212) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 12:27:41 devstack cinder-volume[75212]: DEBUG cinder.service [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75212) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 12:27:42 devstack cinder-volume[75212]: INFO cinder.volume.manager [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 23 12:27:42 devstack cinder-volume[75212]: DEBUG cinder.volume.drivers.lvm [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Updating volume stats {{(pid=75212) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 12:27:42 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:42 devstack sudo[76058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 12:27:42 devstack sudo[76058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:42 devstack sudo[76058]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:42 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:42 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:42 devstack sudo[76064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 12:27:42 devstack sudo[76064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:42 devstack sudo[76064]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:42 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:42 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:42 devstack sudo[76069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 12:27:42 devstack sudo[76069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:42 devstack sudo[76069]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:42 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:42 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:27:42 devstack sudo[76072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 12:27:42 devstack sudo[76072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:27:43 devstack sudo[76072]: pam_unix(sudo:session): session closed for user root Sep 23 12:27:43 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:27:43 devstack cinder-volume[75212]: INFO cinder.volume.manager [None req-bffc15d7-1852-4b6c-ba09-89ff0b5f44db None None] Driver post RPC initialization completed successfully. Sep 23 12:27:45 devstack cinder-volume[75057]: DEBUG dbcounter [-] [75057] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75057) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:27:53 devstack cinder-volume[75212]: DEBUG dbcounter [-] [75212] Writing DB stats cinder:SELECT=3 {{(pid=75212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:27:53 devstack cinder-volume[75212]: DEBUG dbcounter [-] [75212] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:28:00 devstack cinder-volume[75212]: DEBUG oslo_service.periodic_task [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running periodic task VolumeManager._thread_info {{(pid=75212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:28:00 devstack cinder-volume[75212]: DEBUG cinder.volume.manager [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] thread count: 6 {{(pid=75212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:28:00 devstack cinder-volume[75212]: DEBUG cinder.volume.manager [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] thread info: [<_MainThread(MainThread, started 129877479665792)>, , , , , ] {{(pid=75212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:29:00 devstack cinder-volume[75212]: DEBUG oslo_service.periodic_task [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:29:00 devstack cinder-volume[75212]: DEBUG cinder.volume.drivers.lvm [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Updating volume stats {{(pid=75212) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 12:29:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:29:00 devstack sudo[78669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 12:29:00 devstack sudo[78669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:29:00 devstack sudo[78669]: pam_unix(sudo:session): session closed for user root Sep 23 12:29:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:29:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:29:00 devstack sudo[78672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 12:29:00 devstack sudo[78672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:29:00 devstack sudo[78672]: pam_unix(sudo:session): session closed for user root Sep 23 12:29:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:29:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:29:00 devstack sudo[78675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 12:29:00 devstack sudo[78675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:29:01 devstack sudo[78675]: pam_unix(sudo:session): session closed for user root Sep 23 12:29:01 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:29:01 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:29:01 devstack sudo[78678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 12:29:01 devstack sudo[78678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:29:01 devstack sudo[78678]: pam_unix(sudo:session): session closed for user root Sep 23 12:29:01 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:29:01 devstack cinder-volume[75212]: DEBUG cinder.manager [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Notifying Schedulers of capabilities ... {{(pid=75212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:29:01 devstack cinder-volume[75212]: DEBUG oslo_service.periodic_task [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running periodic task VolumeManager._thread_info {{(pid=75212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:29:01 devstack cinder-volume[75212]: DEBUG cinder.volume.manager [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] thread count: 6 {{(pid=75212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:29:01 devstack cinder-volume[75212]: DEBUG cinder.volume.manager [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] thread info: [<_MainThread(MainThread, started 129877479665792)>, , , , , ] {{(pid=75212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:29:53 devstack cinder-volume[75212]: DEBUG dbcounter [-] [75212] Writing DB stats cinder:SELECT=1 {{(pid=75212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:29:53 devstack cinder-volume[75212]: DEBUG dbcounter [-] [75212] Writing DB stats cinder:UPDATE=1 {{(pid=75212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:30:00 devstack cinder-volume[75212]: DEBUG oslo_service.periodic_task [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:30:00 devstack cinder-volume[75212]: DEBUG cinder.volume.drivers.lvm [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Updating volume stats {{(pid=75212) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 12:30:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:30:00 devstack sudo[81684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 12:30:00 devstack sudo[81684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:30:00 devstack sudo[81684]: pam_unix(sudo:session): session closed for user root Sep 23 12:30:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:30:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:30:00 devstack sudo[81687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 12:30:00 devstack sudo[81687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:30:00 devstack sudo[81687]: pam_unix(sudo:session): session closed for user root Sep 23 12:30:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:30:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:30:00 devstack sudo[81691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 12:30:00 devstack sudo[81691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:30:00 devstack sudo[81691]: pam_unix(sudo:session): session closed for user root Sep 23 12:30:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:30:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:30:01 devstack sudo[81694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 12:30:01 devstack sudo[81694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:30:01 devstack sudo[81694]: pam_unix(sudo:session): session closed for user root Sep 23 12:30:01 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:30:01 devstack cinder-volume[75212]: DEBUG cinder.manager [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Notifying Schedulers of capabilities ... {{(pid=75212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:30:01 devstack cinder-volume[75212]: DEBUG oslo_service.periodic_task [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running periodic task VolumeManager._thread_info {{(pid=75212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:30:01 devstack cinder-volume[75212]: DEBUG cinder.volume.manager [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] thread count: 6 {{(pid=75212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:30:01 devstack cinder-volume[75212]: DEBUG cinder.volume.manager [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] thread info: [<_MainThread(MainThread, started 129877479665792)>, , , , , ] {{(pid=75212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:31:00 devstack cinder-volume[75212]: DEBUG oslo_service.periodic_task [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:31:00 devstack cinder-volume[75212]: DEBUG cinder.volume.drivers.lvm [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Updating volume stats {{(pid=75212) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 12:31:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:31:00 devstack sudo[83850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 12:31:00 devstack sudo[83850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:31:00 devstack sudo[83850]: pam_unix(sudo:session): session closed for user root Sep 23 12:31:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:31:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:31:00 devstack sudo[83854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 12:31:00 devstack sudo[83854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:31:00 devstack sudo[83854]: pam_unix(sudo:session): session closed for user root Sep 23 12:31:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:31:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:31:00 devstack sudo[83857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 12:31:00 devstack sudo[83857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:31:00 devstack sudo[83857]: pam_unix(sudo:session): session closed for user root Sep 23 12:31:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:31:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:31:01 devstack sudo[83864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 12:31:01 devstack sudo[83864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:31:01 devstack sudo[83864]: pam_unix(sudo:session): session closed for user root Sep 23 12:31:01 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:31:01 devstack cinder-volume[75212]: DEBUG cinder.manager [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Notifying Schedulers of capabilities ... {{(pid=75212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:31:01 devstack cinder-volume[75212]: DEBUG oslo_service.periodic_task [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running periodic task VolumeManager._thread_info {{(pid=75212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:31:01 devstack cinder-volume[75212]: DEBUG cinder.volume.manager [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] thread count: 6 {{(pid=75212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:31:01 devstack cinder-volume[75212]: DEBUG cinder.volume.manager [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] thread info: [<_MainThread(MainThread, started 129877479665792)>, , , , , ] {{(pid=75212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:31:53 devstack cinder-volume[75212]: DEBUG dbcounter [-] [75212] Writing DB stats cinder:SELECT=1 {{(pid=75212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:31:53 devstack cinder-volume[75212]: DEBUG dbcounter [-] [75212] Writing DB stats cinder:UPDATE=1 {{(pid=75212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:32:00 devstack cinder-volume[75212]: DEBUG oslo_service.periodic_task [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:32:00 devstack cinder-volume[75212]: DEBUG cinder.volume.drivers.lvm [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Updating volume stats {{(pid=75212) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 12:32:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:32:00 devstack sudo[85014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 12:32:00 devstack sudo[85014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:32:00 devstack sudo[85014]: pam_unix(sudo:session): session closed for user root Sep 23 12:32:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:32:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:32:00 devstack sudo[85025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 12:32:00 devstack sudo[85025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:32:00 devstack sudo[85025]: pam_unix(sudo:session): session closed for user root Sep 23 12:32:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:32:00 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:32:00 devstack sudo[85035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 12:32:00 devstack sudo[85035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:32:01 devstack sudo[85035]: pam_unix(sudo:session): session closed for user root Sep 23 12:32:01 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:32:01 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:32:01 devstack sudo[85054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 12:32:01 devstack sudo[85054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:32:01 devstack sudo[85054]: pam_unix(sudo:session): session closed for user root Sep 23 12:32:01 devstack cinder-volume[75212]: DEBUG oslo_concurrency.processutils [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.326s {{(pid=75212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:32:01 devstack cinder-volume[75212]: DEBUG cinder.manager [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Notifying Schedulers of capabilities ... {{(pid=75212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:32:01 devstack cinder-volume[75212]: DEBUG oslo_service.periodic_task [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] Running periodic task VolumeManager._thread_info {{(pid=75212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:32:01 devstack cinder-volume[75212]: DEBUG cinder.volume.manager [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] thread count: 6 {{(pid=75212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:32:01 devstack cinder-volume[75212]: DEBUG cinder.volume.manager [None req-91fd5a12-5ddb-4614-b7e9-685e2caf8ea7 None None] thread info: [<_MainThread(MainThread, started 129877479665792)>, , , , , ] {{(pid=75212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:32:03 devstack cinder-volume[75057]: INFO oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Caught SIGTERM, stopping children Sep 23 12:32:03 devstack cinder-volume[75057]: DEBUG oslo_concurrency.lockutils [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Acquiring lock "singleton_lock" {{(pid=75057) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 12:32:03 devstack cinder-volume[75057]: DEBUG oslo_concurrency.lockutils [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Acquired lock "singleton_lock" {{(pid=75057) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 12:32:03 devstack cinder-volume[75057]: DEBUG oslo_concurrency.lockutils [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Releasing lock "singleton_lock" {{(pid=75057) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 12:32:03 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Stop services. {{(pid=75057) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 23 12:32:03 devstack cinder-volume[75057]: DEBUG oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Killing children. {{(pid=75057) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 23 12:32:03 devstack cinder-volume[75057]: INFO oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Waiting on 1 children to exit Sep 23 12:32:07 devstack cinder-volume[75212]: DEBUG oslo_concurrency.lockutils [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Acquiring lock "singleton_lock" {{(pid=75212) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 12:32:07 devstack cinder-volume[75212]: DEBUG oslo_concurrency.lockutils [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Acquired lock "singleton_lock" {{(pid=75212) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 12:32:07 devstack cinder-volume[75212]: DEBUG oslo_concurrency.lockutils [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Releasing lock "singleton_lock" {{(pid=75212) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 12:32:07 devstack cinder-volume[75212]: WARNING amqp [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 12:32:07 devstack cinder-volume[75212]: WARNING amqp [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 12:32:07 devstack cinder-volume[75057]: INFO oslo_service.backend._eventlet.service [None req-28f8789c-f095-4728-93fa-374a1fea354b None None] Child 75212 exited with status 0 Sep 23 12:32:07 devstack cinder-volume[85211]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 12:32:07 devstack cinder-volume[85211]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 12:32:07 devstack cinder-volume[85211]: we strongly recommend against using it for new projects. Sep 23 12:32:07 devstack cinder-volume[85211]: If you are already using Eventlet, we recommend migrating to a different Sep 23 12:32:07 devstack cinder-volume[85211]: framework. For more detail see Sep 23 12:32:07 devstack cinder-volume[85211]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 12:32:07 devstack cinder-volume[85211]: import eventlet # noqa Sep 23 12:32:09 devstack cinder-volume[85211]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 12:32:09 devstack cinder-volume[85211]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 12:32:09 devstack cinder-volume[85211]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 12:32:10 devstack cinder-volume[85211]: INFO dbcounter [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Registered counter for database cinder Sep 23 12:32:10 devstack cinder-volume[85211]: DEBUG oslo_db.sqlalchemy.engines [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85211) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 12:32:10 devstack cinder-volume[85211]: DEBUG dbcounter [-] [85211] Writer thread running {{(pid=85211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 12:32:10 devstack cinder-volume[85211]: INFO cinder.rpc [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 12:32:10 devstack cinder-volume[85211]: INFO cinder.rpc [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 12:32:10 devstack cinder-volume[85211]: DEBUG oslo_db.sqlalchemy.engines [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85211) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 12:32:10 devstack cinder-volume[85211]: INFO cinder.volume.manager [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Determined volume DB was empty at startup. Sep 23 12:32:10 devstack cinder-volume[85211]: DEBUG cinder.volume.manager [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85211) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 12:32:10 devstack cinder-volume[85211]: INFO cinder.volume.manager [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 23 12:32:10 devstack cinder-volume[85211]: WARNING stevedore.named [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 12:32:10 devstack cinder-volume[85211]: WARNING castellan.key_manager [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 12:32:10 devstack cinder-volume[85211]: WARNING cinder.keymgr.conf_key_mgr [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 12:32:11 devstack cinder-volume[85211]: INFO cinder.volume.manager [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_db.sqlalchemy.engines [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85211) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 12:32:11 devstack cinder-volume[85211]: INFO oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Starting 1 workers Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Started child 85428 {{(pid=85211) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Full set of CONF: {{(pid=85211) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] ******************************************************************************** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Configuration options gathered from: {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] ================================================================================ {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] allow_availability_zone_fallback = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] allow_compression_on_image_upload = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] allowed_direct_url_schemes = [] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85428]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] api_rate_limit = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] auth_strategy = keystone {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_availability_zone = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_host = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_name = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_stats_polling_interval = 60 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backup_api_class = cinder.backup.api.API {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backup_name_template = backup-%s {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backup_use_same_host = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backup_use_temp_snapshot = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] chap_password = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] chap_username = {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cinder_internal_tenant_project_id = 7165f7f98a5b4b36814351da4aee1df5 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cinder_internal_tenant_user_id = d01111c19d564a78acd6e2c7b30d58af {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cluster = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] compression_format = gzip {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] compute_api_class = cinder.compute.nova.API {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] config_dir = [] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] config_source = [] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] control_exchange = openstack {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] debug = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] default_availability_zone = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] default_group_type = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] default_volume_type = QuobyteHD {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] disk_geometry = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] driver_client_cert = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] driver_client_cert_key = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] driver_data_namespace = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] driver_ssl_cert_path = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] driver_ssl_cert_verify = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] driver_use_ssl = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] enable_new_services = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] enable_unsupported_driver = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] enabled_backends = ['QuobyteHD'] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] enforce_multipath_for_image_xfer = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] filter_function = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance_api_insecure = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance_api_servers = ['http://192.168.122.149/image'] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance_api_ssl_compression = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance_ca_certificates_file = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance_catalog_info = image:glance:publicURL {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance_certfile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance_keyfile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance_num_retries = 3 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance_request_timeout = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] goodness_function = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] graceful_shutdown_timeout = 5 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] group_api_class = cinder.group.api.API {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] host = devstack {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] image_compress_on_upload = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] image_conversion_address_space_limit = 1 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] image_conversion_cpu_limit = 60 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] image_conversion_disable = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] image_introspection_address_space_limit = 1 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] image_introspection_cpu_limit = 60 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] image_upload_use_cinder_backend = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] image_upload_use_internal_tenant = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] image_volume_cache_enabled = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] image_volume_cache_max_count = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] image_volume_cache_max_size_gb = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] init_host_max_objects_retrieval = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] instance_format = [instance: %(uuid)s] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] iscsi_target_flags = {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] iscsi_write_cache = on {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] iser_helper = tgtadm {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] iser_ip_address = 192.168.122.149 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] iser_port = 3260 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] log_color = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] log_config_append = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] log_dir = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] log_file = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] log_options = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] log_rotate_interval = 1 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] log_rotate_interval_type = days {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] log_rotation_type = none {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] max_age = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] max_logfile_count = 30 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] max_logfile_size_mb = 200 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] max_over_subscription_ratio = 20.0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] message_reap_interval = 86400 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] message_ttl = 2592000 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] migration_create_volume_timeout_secs = 300 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] monkey_patch = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] monkey_patch_modules = [] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] my_ip = 192.168.122.149 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] no_snapshot_gb_quota = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] num_iser_scan_tries = 3 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] num_shell_tries = 3 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] num_volume_device_scan_tries = 3 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] nvmeof_conn_info_version = 1 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] nvmet_ns_id = 10 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] nvmet_port_id = 1 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] osapi_max_limit = 1000 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] osapi_volume_ext_list = [] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] osapi_volume_listen = 0.0.0.0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] osapi_volume_listen_port = 8776 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] osapi_volume_use_ssl = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] osapi_volume_workers = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] per_volume_size_limit = -1 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] periodic_fuzzy_delay = 60 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] periodic_interval = 60 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] project_id_regex = [0-9a-f\-]+ {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] public_endpoint = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] publish_errors = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] quota_backup_gigabytes = 1000 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] quota_backups = 10 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] quota_gigabytes = 1000 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] quota_groups = 10 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] quota_snapshots = 10 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] quota_volumes = 10 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] rate_limit_burst = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] rate_limit_except_level = CRITICAL {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] rate_limit_interval = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] reinit_driver_count = 3 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] replication_device = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] report_discard_supported = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] report_interval = 120 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] reservation_clean_interval = 86400 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] reservation_expire = 86400 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] reserved_image_namespaces = [] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] reserved_percentage = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] rpc_response_timeout = 120 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] run_external_periodic_tasks = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] scst_target_driver = iscsi {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] scst_target_iqn_name = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] service_down_time = 720 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] shell_completion = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] snapshot_name_template = snapshot-%s {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] split_loggers = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] state_path = /opt/stack/data/cinder {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] storage_availability_zone = nova {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] storage_protocol = iSCSI {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] syslog_log_facility = LOG_USER {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] target_helper = lioadm {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] target_ip_address = 192.168.122.149 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] target_port = 3260 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] target_protocol = iscsi {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] target_secondary_ip_addresses = [] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] trace_flags = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] transfer_api_class = cinder.transfer.api.API {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] transport_url = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] until_refresh = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] use_chap_auth = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] use_default_quota_class = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] use_journal = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] use_json = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] use_multipath_for_image_xfer = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] use_stderr = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] use_syslog = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] verify_glance_signatures = enabled {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] volume_api_class = cinder.volume.api.API {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] volume_backend_name = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] volume_clear = zero {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] volume_clear_ionice = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85428]: INFO cinder.volume.manager [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] volume_clear_size = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85428]: DEBUG cinder.volume.drivers.remotefs [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85428) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] volume_copy_bps_limit = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] volume_dd_blocksize = 1M {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] volume_name_template = volume-%s {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] volume_service_inithost_offload = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] volume_usage_audit_period = month {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] zoning_mode = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_concurrency.disable_process_locking = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.auth_section = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.auth_type = password {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.auth_version = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.cache = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.certfile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.delay_auth_decision = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.http_connect_timeout = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.include_service_catalog = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.insecure = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.interface = public {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.keyfile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.memcache_password = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.memcache_username = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.region_name = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.service_token_roles_required = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.service_type = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.token_cache_time = 300 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.149/identity {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.backend = dogpile.cache.null {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.backend_argument = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.backend_expiration_time = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.config_prefix = cache.oslo {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.debug_cache_backend = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.enable_retry_client = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.enable_socket_keepalive = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.enabled = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.expiration_time = 600 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.hashclient_retry_attempts = 2 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.memcache_dead_retry = 300 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.memcache_pool_maxsize = 10 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.memcache_sasl_enabled = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.password = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.proxies = [] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.redis_db = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.redis_sentinel_service_name = mymaster {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.redis_server = localhost:6379 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.retry_attempts = 2 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.retry_delay = 0.0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.socket_keepalive_count = 1 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.socket_keepalive_idle = 1 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.socket_keepalive_interval = 1 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.socket_timeout = 1.0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.tls_allowed_ciphers = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.tls_cafile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.tls_certfile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.tls_enabled = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.tls_keyfile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cache.username = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] coordination.backend_url = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.asyncio_connection = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.asyncio_slave_connection = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.backend = sqlalchemy {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.connection = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.connection_debug = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.connection_parameters = {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.connection_recycle_time = 3600 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.connection_trace = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.db_inc_retry_interval = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.db_max_retries = 20 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.db_max_retry_interval = 10 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.db_retry_interval = 1 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.max_overflow = 50 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.max_pool_size = 5 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.max_retries = 10 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.mysql_wsrep_sync_wait = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.pool_timeout = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.retry_interval = 10 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.slave_connection = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.sqlite_synchronous = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.synchronous_reader = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] database.use_db_reconnect = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_tracing.insecure = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] profiler.connection_string = messaging:// {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] profiler.enabled = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] profiler.es_doc_type = notification {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] profiler.es_scroll_size = 10000 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] profiler.es_scroll_time = 2m {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] profiler.filter_error_trace = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] profiler.hmac_keys = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] profiler.sentinel_service_name = mymaster {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] profiler.socket_timeout = 0.1 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] profiler.trace_requests = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] profiler.trace_sqlalchemy = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] profiler_jaeger.process_tags = {} {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] profiler_jaeger.service_name_prefix = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] profiler_otlp.service_name_prefix = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_policy.enforce_new_defaults = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_policy.policy_default_rule = default {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_policy.policy_file = policy.yaml {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_policy.remote_timeout = 60.0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] privsep_osbrick.group = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] privsep_osbrick.helper_command = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] privsep_osbrick.user = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cinder_sys_admin.group = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cinder_sys_admin.helper_command = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] cinder_sys_admin.user = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] service_user.auth_section = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] service_user.auth_type = password {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] service_user.cafile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] service_user.certfile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] service_user.collect_timing = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] service_user.insecure = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] service_user.keyfile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] service_user.send_service_user_token = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] service_user.split_loggers = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] service_user.timeout = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] service_user.tls_ciphers = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] service_user.tls_min_version = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance.auth_section = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance.auth_type = password {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance.certfile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance.collect_timing = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance.insecure = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance.keyfile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance.region_name = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance.split_loggers = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance.timeout = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance.tls_ciphers = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] glance.tls_min_version = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.backend_availability_zone = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.chap_password = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.chap_username = {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.disk_geometry = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.driver_client_cert = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.driver_client_cert_key = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.driver_data_namespace = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.driver_use_ssl = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.enable_unsupported_driver = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.extra_capabilities = {} {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.filter_function = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.goodness_function = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.iscsi_target_flags = {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.iscsi_write_cache = on {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.iser_helper = tgtadm {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.iser_ip_address = 192.168.122.149 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.iser_port = 3260 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.nas_host = {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.nas_login = admin {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.nas_mount_options = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.nas_password = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.nas_private_key = {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.nas_share_path = {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.nas_ssh_port = 22 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.num_shell_tries = 3 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.nvmet_port_id = 1 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.quobyte_client_cfg = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.quobyte_volume_url = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.replication_device = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.report_discard_supported = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.reserved_percentage = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.scst_target_driver = iscsi {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.scst_target_iqn_name = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.storage_protocol = iSCSI {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.target_helper = tgtadm {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.target_ip_address = 192.168.122.149 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.target_port = 3260 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.target_protocol = iscsi {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.trace_flags = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.unique_fqdn_network = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.use_chap_auth = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.volume_backend_name = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.volume_clear = zero {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.volume_clear_ionice = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.volume_clear_size = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_reports.file_event_handler = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_reports.log_dir = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.backend_availability_zone = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.backend_host = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.chap_password = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.chap_username = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.chiscsi_conf = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.disk_geometry = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.driver_client_cert = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.driver_client_cert_key = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.driver_data_namespace = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.driver_use_ssl = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.extra_capabilities = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.filter_function = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.goodness_function = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.iscsi_target_flags = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.iscsi_write_cache = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.iser_helper = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.iser_ip_address = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.iser_port = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.iser_target_prefix = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.nas_host = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.nas_login = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.nas_mount_options = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.nas_password = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.nas_private_key = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.nas_share_path = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.nas_ssh_port = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.num_shell_tries = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.nvmet_ns_id = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.nvmet_port_id = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.replication_device = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.report_discard_supported = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.reserved_percentage = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.scst_target_driver = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.storage_protocol = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.target_helper = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.target_ip_address = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.target_port = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.target_prefix = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.target_protocol = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.trace_flags = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85428]: DEBUG cinder.volume.drivers.quobyte [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85428) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.unique_fqdn_network = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.use_chap_auth = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.volume_clear = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.volume_clear_ionice = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.volume_clear_size = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] QuobyteHD.volumes_dir = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85428]: WARNING cinder.volume.drivers.quobyte [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85428]: WARNING cinder.volume.drivers.quobyte [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85428]: DEBUG oslo_concurrency.processutils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Running cmd (subprocess): mount.quobyte {{(pid=85428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.ssl = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.ssl_version = {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_notifications.driver = [] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_notifications.retry = -1 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] oslo_messaging_notifications.transport_url = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] key_manager.fixed_key = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican.barbican_api_version = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican.barbican_endpoint = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican.barbican_endpoint_type = public {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican.barbican_region_name = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican.cafile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican.certfile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican.collect_timing = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican.insecure = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican.keyfile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican.number_of_retries = 60 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican.retry_delay = 1 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican.send_service_user_token = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican.split_loggers = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican.timeout = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican.tls_ciphers = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican.tls_min_version = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican.verify_ssl = True {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican.verify_ssl_path = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican_service_user.auth_section = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican_service_user.auth_type = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican_service_user.cafile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican_service_user.certfile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican_service_user.collect_timing = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican_service_user.insecure = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican_service_user.keyfile = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican_service_user.split_loggers = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican_service_user.timeout = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican_service_user.tls_ciphers = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] barbican_service_user.tls_min_version = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] vault.approle_role_id = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] vault.approle_secret_id = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] vault.auth_method = approle {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] vault.auth_path = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] vault.kv_mountpoint = secret {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] vault.kv_path = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] vault.kv_version = 2 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] vault.namespace = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] vault.root_token_id = **** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] vault.ssl_ca_crt_file = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] vault.timeout = 60.0 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] vault.token_file = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] vault.token_role = None {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] vault.use_ssl = False {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:11 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] ******************************************************************************** {{(pid=85211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 12:32:11 devstack quobyte-client[85431]: Reading configuration file: /etc/quobyte/client.cfg Sep 23 12:32:11 devstack quobyte-client[85431]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 23 12:32:11 devstack cinder-volume[85428]: DEBUG oslo_concurrency.processutils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] CMD "mount.quobyte" returned: 1 in 0.080s {{(pid=85428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:32:11 devstack cinder-volume[85428]: DEBUG oslo_concurrency.lockutils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:32:11 devstack cinder-volume[85428]: DEBUG oslo_concurrency.lockutils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:32:11 devstack cinder-volume[85428]: DEBUG cinder.volume.drivers.quobyte [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=85428) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:32:11 devstack cinder-volume[85428]: INFO cinder.volume.drivers.quobyte [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 ... Sep 23 12:32:11 devstack cinder-volume[85428]: DEBUG oslo_concurrency.processutils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d -c /etc/quobyte/client-cinder.cfg {{(pid=85428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:32:11 devstack sudo[85432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d -c /etc/quobyte/client-cinder.cfg Sep 23 12:32:11 devstack sudo[85432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:32:11 devstack sudo[85432]: pam_unix(sudo:session): session closed for user root Sep 23 12:32:11 devstack cinder-volume[85428]: DEBUG oslo_concurrency.processutils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.391s {{(pid=85428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:32:11 devstack cinder-volume[85428]: INFO cinder.volume.drivers.quobyte [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 succeeded Sep 23 12:32:11 devstack cinder-volume[85428]: DEBUG cinder.volume.drivers.quobyte [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=85428) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:32:11 devstack cinder-volume[85428]: DEBUG oslo_concurrency.lockutils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.401s {{(pid=85428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:32:11 devstack cinder-volume[85428]: DEBUG oslo_concurrency.processutils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=85428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:32:11 devstack sudo[85531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:32:11 devstack sudo[85531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:32:12 devstack sudo[85531]: pam_unix(sudo:session): session closed for user root Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG oslo_concurrency.processutils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.235s {{(pid=85428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:32:12 devstack cinder-volume[85428]: INFO cinder.volume.driver [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Driver hasn't implemented _init_vendor_properties() Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG cinder.volume.driver [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4653587341309, 'free_capacity_gb': 1775.4653587341309, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85428) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG oslo_db.sqlalchemy.engines [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85428) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG dbcounter [-] [85428] Writer thread running {{(pid=85428) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG cinder.db.api [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Building query based on filter {{(pid=85428) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG cinder.image.image_utils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85428) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 12:32:12 devstack cinder-volume[85428]: INFO cinder.keymgr.migration [None req-a53c10b4-e6d0-457a-a660-f7b822c9dd2a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG oslo_concurrency.lockutils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG oslo_concurrency.lockutils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG cinder.volume.drivers.quobyte [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=85428) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG cinder.volume.drivers.quobyte [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=85428) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG oslo_concurrency.lockutils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG oslo_concurrency.processutils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=85428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:32:12 devstack sudo[85534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:32:12 devstack sudo[85534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:32:12 devstack sudo[85534]: pam_unix(sudo:session): session closed for user root Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG oslo_concurrency.processutils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.221s {{(pid=85428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG cinder.manager [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Notifying Schedulers of capabilities ... {{(pid=85428) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:32:12 devstack cinder-volume[85428]: INFO cinder.volume.manager [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Driver initialization completed successfully. Sep 23 12:32:12 devstack cinder-volume[85428]: INFO cinder.manager [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Initiating service 3 cleanup Sep 23 12:32:12 devstack cinder-volume[85428]: INFO cinder.manager [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Service 3 cleanup completed. Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG cinder.service [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Creating RPC server for service cinder-volume {{(pid=85428) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG cinder.service [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85428) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 12:32:12 devstack cinder-volume[85428]: INFO cinder.volume.manager [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG oslo_concurrency.lockutils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG oslo_concurrency.lockutils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG cinder.volume.drivers.quobyte [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=85428) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG cinder.volume.drivers.quobyte [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=85428) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG oslo_concurrency.lockutils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG oslo_concurrency.processutils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=85428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:32:12 devstack sudo[85538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:32:12 devstack sudo[85538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:32:12 devstack sudo[85538]: pam_unix(sudo:session): session closed for user root Sep 23 12:32:12 devstack cinder-volume[85428]: DEBUG oslo_concurrency.processutils [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.235s {{(pid=85428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:32:12 devstack cinder-volume[85428]: INFO cinder.volume.manager [None req-84efc889-5c01-4898-8f01-7501fde27329 None None] Driver post RPC initialization completed successfully. Sep 23 12:32:17 devstack cinder-volume[85211]: INFO oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Caught SIGTERM, stopping children Sep 23 12:32:17 devstack cinder-volume[85211]: DEBUG oslo_concurrency.lockutils [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Acquiring lock "singleton_lock" {{(pid=85211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 12:32:17 devstack cinder-volume[85211]: DEBUG oslo_concurrency.lockutils [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Acquired lock "singleton_lock" {{(pid=85211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 12:32:17 devstack cinder-volume[85211]: DEBUG oslo_concurrency.lockutils [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Releasing lock "singleton_lock" {{(pid=85211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 12:32:17 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Stop services. {{(pid=85211) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 23 12:32:17 devstack cinder-volume[85211]: DEBUG oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Killing children. {{(pid=85211) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 23 12:32:17 devstack cinder-volume[85211]: INFO oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Waiting on 1 children to exit Sep 23 12:32:20 devstack cinder-volume[85428]: DEBUG oslo_concurrency.lockutils [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Acquiring lock "singleton_lock" {{(pid=85428) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 12:32:20 devstack cinder-volume[85428]: DEBUG oslo_concurrency.lockutils [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Acquired lock "singleton_lock" {{(pid=85428) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 12:32:20 devstack cinder-volume[85428]: DEBUG oslo_concurrency.lockutils [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Releasing lock "singleton_lock" {{(pid=85428) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 12:32:20 devstack cinder-volume[85428]: WARNING amqp [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 12:32:20 devstack cinder-volume[85428]: WARNING amqp [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 12:32:20 devstack cinder-volume[85211]: INFO oslo_service.backend._eventlet.service [None req-0e9bfe22-ded5-4935-bf0f-a84ebf47875f None None] Child 85428 exited with status 0 Sep 23 12:32:21 devstack cinder-volume[85777]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 12:32:21 devstack cinder-volume[85777]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 12:32:21 devstack cinder-volume[85777]: we strongly recommend against using it for new projects. Sep 23 12:32:21 devstack cinder-volume[85777]: If you are already using Eventlet, we recommend migrating to a different Sep 23 12:32:21 devstack cinder-volume[85777]: framework. For more detail see Sep 23 12:32:21 devstack cinder-volume[85777]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 12:32:21 devstack cinder-volume[85777]: import eventlet # noqa Sep 23 12:32:24 devstack cinder-volume[85777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85777) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 12:32:24 devstack cinder-volume[85777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85777) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 12:32:24 devstack cinder-volume[85777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85777) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 12:32:25 devstack cinder-volume[85777]: INFO dbcounter [None req-5281367a-7718-453a-a470-accc004663ab None None] Registered counter for database cinder Sep 23 12:32:25 devstack cinder-volume[85777]: DEBUG oslo_db.sqlalchemy.engines [None req-5281367a-7718-453a-a470-accc004663ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85777) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 12:32:25 devstack cinder-volume[85777]: DEBUG dbcounter [-] [85777] Writer thread running {{(pid=85777) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 12:32:25 devstack cinder-volume[85777]: INFO cinder.rpc [None req-5281367a-7718-453a-a470-accc004663ab None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 12:32:25 devstack cinder-volume[85777]: INFO cinder.rpc [None req-5281367a-7718-453a-a470-accc004663ab None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 12:32:25 devstack cinder-volume[85777]: DEBUG oslo_db.sqlalchemy.engines [None req-5281367a-7718-453a-a470-accc004663ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85777) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 12:32:25 devstack cinder-volume[85777]: INFO cinder.volume.manager [None req-5281367a-7718-453a-a470-accc004663ab None None] Determined volume DB was empty at startup. Sep 23 12:32:25 devstack cinder-volume[85777]: DEBUG cinder.volume.manager [None req-5281367a-7718-453a-a470-accc004663ab None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85777) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 12:32:25 devstack cinder-volume[85777]: WARNING stevedore.named [None req-5281367a-7718-453a-a470-accc004663ab None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 12:32:25 devstack cinder-volume[85777]: WARNING castellan.key_manager [None req-5281367a-7718-453a-a470-accc004663ab None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 12:32:25 devstack cinder-volume[85777]: WARNING cinder.keymgr.conf_key_mgr [None req-5281367a-7718-453a-a470-accc004663ab None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 12:32:25 devstack cinder-volume[85777]: INFO cinder.volume.manager [None req-5281367a-7718-453a-a470-accc004663ab None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_db.sqlalchemy.engines [None req-5281367a-7718-453a-a470-accc004663ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85777) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 12:32:26 devstack cinder-volume[85777]: INFO oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] Starting 1 workers Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] Started child 86085 {{(pid=85777) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] Full set of CONF: {{(pid=85777) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] ******************************************************************************** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] Configuration options gathered from: {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] ================================================================================ {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] allow_availability_zone_fallback = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] allow_compression_on_image_upload = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] allowed_direct_url_schemes = [] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] api_rate_limit = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] auth_strategy = keystone {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_availability_zone = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_host = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_name = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_stats_polling_interval = 60 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backup_api_class = cinder.backup.api.API {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backup_name_template = backup-%s {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backup_use_same_host = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backup_use_temp_snapshot = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] chap_password = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] chap_username = {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cinder_internal_tenant_project_id = 7165f7f98a5b4b36814351da4aee1df5 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cinder_internal_tenant_user_id = d01111c19d564a78acd6e2c7b30d58af {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cluster = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] compression_format = gzip {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] compute_api_class = cinder.compute.nova.API {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] config_dir = [] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] config_source = [] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[86085]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] control_exchange = openstack {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] debug = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] default_availability_zone = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] default_group_type = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] default_volume_type = QuobyteHD {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] disk_geometry = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] driver_client_cert = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] driver_client_cert_key = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] driver_data_namespace = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] driver_ssl_cert_path = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] driver_ssl_cert_verify = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] driver_use_ssl = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] enable_new_services = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] enable_unsupported_driver = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] enabled_backends = ['QuobyteHD'] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] enforce_multipath_for_image_xfer = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] filter_function = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance_api_insecure = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance_api_servers = ['http://192.168.122.149/image'] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance_api_ssl_compression = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance_ca_certificates_file = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance_catalog_info = image:glance:publicURL {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance_certfile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance_keyfile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance_num_retries = 3 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance_request_timeout = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] goodness_function = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] graceful_shutdown_timeout = 5 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] group_api_class = cinder.group.api.API {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] host = devstack {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] image_compress_on_upload = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] image_conversion_address_space_limit = 1 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] image_conversion_cpu_limit = 60 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] image_conversion_disable = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] image_introspection_address_space_limit = 1 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] image_introspection_cpu_limit = 60 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] image_upload_use_cinder_backend = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] image_upload_use_internal_tenant = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] image_volume_cache_enabled = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] image_volume_cache_max_count = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] image_volume_cache_max_size_gb = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] init_host_max_objects_retrieval = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] instance_format = [instance: %(uuid)s] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] iscsi_target_flags = {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] iscsi_write_cache = on {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] iser_helper = tgtadm {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] iser_ip_address = 192.168.122.149 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] iser_port = 3260 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] log_color = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] log_config_append = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] log_dir = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] log_file = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] log_options = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] log_rotate_interval = 1 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] log_rotate_interval_type = days {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] log_rotation_type = none {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] max_age = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] max_logfile_count = 30 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] max_logfile_size_mb = 200 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] max_over_subscription_ratio = 20.0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] message_reap_interval = 86400 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] message_ttl = 2592000 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] migration_create_volume_timeout_secs = 300 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] monkey_patch = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] monkey_patch_modules = [] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] my_ip = 192.168.122.149 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] no_snapshot_gb_quota = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] num_iser_scan_tries = 3 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] num_shell_tries = 3 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] num_volume_device_scan_tries = 3 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] nvmeof_conn_info_version = 1 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] nvmet_ns_id = 10 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] nvmet_port_id = 1 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] osapi_max_limit = 1000 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] osapi_volume_ext_list = [] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] osapi_volume_listen = 0.0.0.0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] osapi_volume_listen_port = 8776 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] osapi_volume_use_ssl = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] osapi_volume_workers = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] per_volume_size_limit = -1 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] periodic_fuzzy_delay = 60 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] periodic_interval = 60 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] project_id_regex = [0-9a-f\-]+ {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] public_endpoint = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] publish_errors = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] quota_backup_gigabytes = 1000 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] quota_backups = 10 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] quota_gigabytes = 1000 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] quota_groups = 10 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] quota_snapshots = 10 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] quota_volumes = 10 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] rate_limit_burst = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] rate_limit_except_level = CRITICAL {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] rate_limit_interval = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] reinit_driver_count = 3 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] replication_device = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] report_discard_supported = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] report_interval = 120 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Starting volume driver QuobyteDriver (1.2.1) Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] reservation_clean_interval = 86400 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86085) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] reservation_expire = 86400 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] reserved_image_namespaces = [] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] reserved_percentage = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] rpc_response_timeout = 120 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] run_external_periodic_tasks = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] scst_target_driver = iscsi {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] scst_target_iqn_name = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] service_down_time = 720 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] shell_completion = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] snapshot_name_template = snapshot-%s {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] split_loggers = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] state_path = /opt/stack/data/cinder {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] storage_availability_zone = nova {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] storage_protocol = iSCSI {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] syslog_log_facility = LOG_USER {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] target_helper = lioadm {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] target_ip_address = 192.168.122.149 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] target_port = 3260 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] target_protocol = iscsi {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] target_secondary_ip_addresses = [] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] trace_flags = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] transfer_api_class = cinder.transfer.api.API {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] transport_url = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] until_refresh = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] use_chap_auth = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] use_default_quota_class = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] use_journal = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] use_json = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] use_multipath_for_image_xfer = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] use_stderr = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] use_syslog = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] verify_glance_signatures = enabled {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] volume_api_class = cinder.volume.api.API {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] volume_backend_name = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] volume_clear = zero {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] volume_clear_ionice = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] volume_clear_size = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] volume_copy_bps_limit = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] volume_dd_blocksize = 1M {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] volume_name_template = volume-%s {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] volume_service_inithost_offload = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] volume_usage_audit_period = month {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] zoning_mode = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_concurrency.disable_process_locking = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.auth_section = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.auth_type = password {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.auth_version = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.cache = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.certfile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.delay_auth_decision = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.http_connect_timeout = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.include_service_catalog = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.insecure = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.interface = public {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.keyfile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.memcache_password = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.memcache_username = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.region_name = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.service_token_roles_required = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.service_type = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.token_cache_time = 300 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.149/identity {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.backend = dogpile.cache.null {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.backend_argument = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.backend_expiration_time = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.config_prefix = cache.oslo {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.debug_cache_backend = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.enable_retry_client = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.enable_socket_keepalive = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.enabled = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.expiration_time = 600 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.hashclient_retry_attempts = 2 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.memcache_dead_retry = 300 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.memcache_pool_maxsize = 10 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.memcache_sasl_enabled = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.password = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.proxies = [] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.redis_db = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.redis_sentinel_service_name = mymaster {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.redis_server = localhost:6379 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.retry_attempts = 2 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.retry_delay = 0.0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.socket_keepalive_count = 1 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.socket_keepalive_idle = 1 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.socket_keepalive_interval = 1 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86085) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 23 12:32:26 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.quobyte [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 23 12:32:26 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.quobyte [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.socket_timeout = 1.0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.tls_allowed_ciphers = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.tls_cafile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.tls_certfile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.tls_enabled = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.tls_keyfile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cache.username = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] coordination.backend_url = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.asyncio_connection = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Running cmd (subprocess): mount.quobyte {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.asyncio_slave_connection = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.backend = sqlalchemy {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.connection = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.connection_debug = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.connection_parameters = {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.connection_recycle_time = 3600 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.connection_trace = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.db_inc_retry_interval = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.db_max_retries = 20 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.db_max_retry_interval = 10 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.db_retry_interval = 1 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.max_overflow = 50 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.max_pool_size = 5 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.max_retries = 10 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.mysql_wsrep_sync_wait = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.pool_timeout = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.retry_interval = 10 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.slave_connection = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.sqlite_synchronous = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.synchronous_reader = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] database.use_db_reconnect = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_tracing.insecure = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] profiler.connection_string = messaging:// {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] profiler.enabled = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] profiler.es_doc_type = notification {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] profiler.es_scroll_size = 10000 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] profiler.es_scroll_time = 2m {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] profiler.filter_error_trace = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] profiler.hmac_keys = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] profiler.sentinel_service_name = mymaster {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] profiler.socket_timeout = 0.1 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] profiler.trace_requests = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] profiler.trace_sqlalchemy = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] profiler_jaeger.process_tags = {} {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] profiler_jaeger.service_name_prefix = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] profiler_otlp.service_name_prefix = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_policy.enforce_new_defaults = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_policy.policy_default_rule = default {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_policy.policy_file = policy.yaml {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_policy.remote_timeout = 60.0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] privsep_osbrick.group = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] privsep_osbrick.helper_command = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] privsep_osbrick.user = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cinder_sys_admin.group = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cinder_sys_admin.helper_command = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] cinder_sys_admin.user = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] service_user.auth_section = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] service_user.auth_type = password {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] service_user.cafile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] service_user.certfile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] service_user.collect_timing = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] service_user.insecure = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] service_user.keyfile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] service_user.send_service_user_token = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] service_user.split_loggers = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] service_user.timeout = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] service_user.tls_ciphers = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] service_user.tls_min_version = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance.auth_section = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance.auth_type = password {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance.certfile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance.collect_timing = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance.insecure = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance.keyfile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance.region_name = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance.split_loggers = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance.timeout = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance.tls_ciphers = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] glance.tls_min_version = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.backend_availability_zone = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.chap_password = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.chap_username = {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.disk_geometry = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.driver_client_cert = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.driver_client_cert_key = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.driver_data_namespace = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.driver_use_ssl = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.enable_unsupported_driver = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.extra_capabilities = {} {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.filter_function = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.goodness_function = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.iscsi_target_flags = {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.iscsi_write_cache = on {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.iser_helper = tgtadm {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.iser_ip_address = 192.168.122.149 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.iser_port = 3260 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.nas_host = {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.nas_login = admin {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.nas_mount_options = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.nas_password = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.nas_private_key = {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.nas_share_path = {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.nas_ssh_port = 22 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.num_shell_tries = 3 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.nvmet_port_id = 1 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.quobyte_client_cfg = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.quobyte_volume_url = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.replication_device = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.report_discard_supported = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.reserved_percentage = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.scst_target_driver = iscsi {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.scst_target_iqn_name = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.storage_protocol = iSCSI {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.target_helper = tgtadm {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.target_ip_address = 192.168.122.149 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.target_port = 3260 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.target_protocol = iscsi {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.trace_flags = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.unique_fqdn_network = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.use_chap_auth = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.volume_backend_name = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.volume_clear = zero {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.volume_clear_ionice = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.volume_clear_size = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_reports.file_event_handler = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_reports.log_dir = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.backend_availability_zone = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.backend_host = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.chap_password = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.chap_username = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.chiscsi_conf = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.disk_geometry = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.driver_client_cert = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.driver_client_cert_key = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.driver_data_namespace = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.driver_use_ssl = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.extra_capabilities = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.filter_function = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.goodness_function = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack quobyte-client[86086]: Reading configuration file: /etc/quobyte/client.cfg Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.iscsi_target_flags = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.iscsi_write_cache = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack quobyte-client[86086]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.iser_helper = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.iser_ip_address = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.iser_port = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.iser_target_prefix = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.nas_host = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.nas_login = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.nas_mount_options = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.nas_password = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.nas_private_key = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.nas_share_path = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.nas_ssh_port = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.num_shell_tries = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.nvmet_ns_id = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.nvmet_port_id = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.replication_device = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.report_discard_supported = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.reserved_percentage = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.scst_target_driver = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.storage_protocol = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.target_helper = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.target_ip_address = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.target_port = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.target_prefix = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.target_protocol = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.trace_flags = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.unique_fqdn_network = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.use_chap_auth = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.volume_clear = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.volume_clear_ionice = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.volume_clear_size = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] QuobyteHD.volumes_dir = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.ssl = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.ssl_version = {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_notifications.driver = [] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_notifications.retry = -1 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] oslo_messaging_notifications.transport_url = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] key_manager.fixed_key = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican.barbican_api_version = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican.barbican_endpoint = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican.barbican_endpoint_type = public {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican.barbican_region_name = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican.cafile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican.certfile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican.collect_timing = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican.insecure = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican.keyfile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican.number_of_retries = 60 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican.retry_delay = 1 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican.send_service_user_token = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican.split_loggers = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican.timeout = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican.tls_ciphers = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican.tls_min_version = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican.verify_ssl = True {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican.verify_ssl_path = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican_service_user.auth_section = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican_service_user.auth_type = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican_service_user.cafile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack sudo[86087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican_service_user.certfile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican_service_user.collect_timing = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican_service_user.insecure = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican_service_user.keyfile = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican_service_user.split_loggers = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican_service_user.timeout = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican_service_user.tls_ciphers = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] barbican_service_user.tls_min_version = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] vault.approle_role_id = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] vault.approle_secret_id = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] vault.auth_method = approle {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] vault.auth_path = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] vault.kv_mountpoint = secret {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] vault.kv_path = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] vault.kv_version = 2 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] vault.namespace = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] vault.root_token_id = **** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] vault.ssl_ca_crt_file = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] vault.timeout = 60.0 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] vault.token_file = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] vault.token_role = None {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] vault.use_ssl = False {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 12:32:26 devstack cinder-volume[85777]: DEBUG oslo_service.backend._eventlet.service [None req-5281367a-7718-453a-a470-accc004663ab None None] ******************************************************************************** {{(pid=85777) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 12:32:26 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.243s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:32:26 devstack cinder-volume[86085]: INFO cinder.volume.driver [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Driver hasn't implemented _init_vendor_properties() Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG cinder.volume.driver [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4653587341309, 'free_capacity_gb': 1775.4653587341309, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86085) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG oslo_db.sqlalchemy.engines [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86085) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writer thread running {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG cinder.db.api [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Building query based on filter {{(pid=86085) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86085) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:32:26 devstack cinder-volume[86085]: INFO cinder.keymgr.migration [None req-6fe04bb7-b2eb-4713-a647-4b48411d8b76 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 12:32:26 devstack sudo[86100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:32:26 devstack sudo[86100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:32:26 devstack sudo[86100]: pam_unix(sudo:session): session closed for user root Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.246s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:32:26 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Driver initialization completed successfully. Sep 23 12:32:26 devstack cinder-volume[86085]: INFO cinder.manager [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Initiating service 3 cleanup Sep 23 12:32:26 devstack cinder-volume[86085]: INFO cinder.manager [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Service 3 cleanup completed. Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG cinder.service [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Creating RPC server for service cinder-volume {{(pid=86085) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 12:32:26 devstack cinder-volume[86085]: DEBUG cinder.service [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86085) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 12:32:27 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 23 12:32:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:32:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:32:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:32:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:32:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:32:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:32:27 devstack sudo[86111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:32:27 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:32:27 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root Sep 23 12:32:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.254s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:32:27 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-fafad415-0aec-4bf7-8215-d772d7e87a3e None None] Driver post RPC initialization completed successfully. Sep 23 12:32:36 devstack cinder-volume[85777]: DEBUG dbcounter [-] [85777] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85777) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:32:36 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:32:37 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=3 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:32:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:32:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 6 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:32:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Flow 'volume_create_manager' (eb7a117a-30e6-4eb4-8121-9fb0d902b5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86fcb286-4df6-4fd0-a5ac-204b449f07a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86fcb286-4df6-4fd0-a5ac-204b449f07a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2010034493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f6da7955c443249f6c15c9658a13bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:33:40Z,use_quota=True,user_id='33070a036cc8474eac7af31d95244607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e669a441-caca-4cbc-b79f-90f3572eef22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e669a441-caca-4cbc-b79f-90f3572eef22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dbb9b41-f78d-4a89-92a2-8ef872c689f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dbb9b41-f78d-4a89-92a2-8ef872c689f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a', 'volume_name': 'volume-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feed5baf-4331-4313-b2ee-d0f21690c6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feed5baf-4331-4313-b2ee-d0f21690c6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b50d18a-10e4-4946-bc8d-3d8d6b1d3c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:33:40 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Volume b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a', 'volume_size': 1} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2010034493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f6da7955c443249f6c15c9658a13bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:33:40Z,use_quota=True,user_id='33070a036cc8474eac7af31d95244607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Creating volume b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:33:40 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:33:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:33:40 devstack sudo[86862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a 1073741824 Sep 23 12:33:40 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:33:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:33:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:33:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:33:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:33:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:33:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:33:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:33:41 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:33:41 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:33:42 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Sep 23 12:33:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.925s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:33:42 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:33:42 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:33:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 6 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:33:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:33:42 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root Sep 23 12:33:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a 1073741824" returned: 0 in 1.633s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:33:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:33:42 devstack sudo[87191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a Sep 23 12:33:42 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:33:43 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root Sep 23 12:33:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a" returned: 0 in 0.447s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:33:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] <== create_volume: return (2247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:33:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.258s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:33:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b50d18a-10e4-4946-bc8d-3d8d6b1d3c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:33:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (851b2a74-80dc-4ec1-8462-31edcf37998a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:33:43 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Volume volume-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a (b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a): created successfully Sep 23 12:33:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (851b2a74-80dc-4ec1-8462-31edcf37998a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:33:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Flow 'volume_create_manager' (eb7a117a-30e6-4eb4-8121-9fb0d902b5ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:33:43 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-077840fa-e675-4ff8-a7ea-9d33a1215368 tempest-DeleteServersTestJSON-1157925965 None] Created volume successfully. Sep 23 12:33:46 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:33:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Flow 'volume_create_manager' (cd2e79bd-7f4a-438e-ba78-53ae38475666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:33:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4498a778-8368-4396-9e2e-607f889faf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:33:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4498a778-8368-4396-9e2e-607f889faf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1886883657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9b317f-6578-45da-95dc-9f48519bff54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58978c98e9fd49df8bb385266aa516e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:33:47Z,use_quota=True,user_id='b2051ce0b8364af6a49aacee39871378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:33:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4367e6b6-077a-4055-a2b9-8daf6a41f218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:33:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4367e6b6-077a-4055-a2b9-8daf6a41f218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:33:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815cec0e-03d7-40a3-9405-1fd3a8108247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:33:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815cec0e-03d7-40a3-9405-1fd3a8108247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de9b317f-6578-45da-95dc-9f48519bff54', 'volume_name': 'volume-de9b317f-6578-45da-95dc-9f48519bff54', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:33:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328f856e-ad76-4118-897e-092c853f9cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:33:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328f856e-ad76-4118-897e-092c853f9cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:33:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9948de7f-11a9-4397-83e5-8520d47d7fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:33:47 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Volume de9b317f-6578-45da-95dc-9f48519bff54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de9b317f-6578-45da-95dc-9f48519bff54', 'volume_size': 1} Sep 23 12:33:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:33:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:33:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1886883657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9b317f-6578-45da-95dc-9f48519bff54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58978c98e9fd49df8bb385266aa516e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:33:47Z,use_quota=True,user_id='b2051ce0b8364af6a49aacee39871378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:33:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Creating volume de9b317f-6578-45da-95dc-9f48519bff54 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:33:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:33:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:33:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:33:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:33:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:33:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:33:47 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:33:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-de9b317f-6578-45da-95dc-9f48519bff54 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:33:47 devstack sudo[87203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-de9b317f-6578-45da-95dc-9f48519bff54 1073741824 Sep 23 12:33:47 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:33:48 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root Sep 23 12:33:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-de9b317f-6578-45da-95dc-9f48519bff54 1073741824" returned: 0 in 1.441s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:33:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-de9b317f-6578-45da-95dc-9f48519bff54 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:33:48 devstack sudo[87215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-de9b317f-6578-45da-95dc-9f48519bff54 Sep 23 12:33:48 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:33:49 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root Sep 23 12:33:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-de9b317f-6578-45da-95dc-9f48519bff54" returned: 0 in 0.651s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:33:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] <== create_volume: return (2288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:33:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.291s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:33:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9948de7f-11a9-4397-83e5-8520d47d7fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de9b317f-6578-45da-95dc-9f48519bff54', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:33:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43412fcb-285a-4b21-98f3-aa9daca1a240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:33:49 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Volume volume-de9b317f-6578-45da-95dc-9f48519bff54 (de9b317f-6578-45da-95dc-9f48519bff54): created successfully Sep 23 12:33:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43412fcb-285a-4b21-98f3-aa9daca1a240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:33:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Flow 'volume_create_manager' (cd2e79bd-7f4a-438e-ba78-53ae38475666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:33:49 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-6523c2ec-c900-42d4-a798-bb195ebb3d32 tempest-VolumesAdminNegativeTest-1983485800 None] Created volume successfully. Sep 23 12:33:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Acquiring lock "cinder-de9b317f-6578-45da-95dc-9f48519bff54-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:33:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Lock "cinder-de9b317f-6578-45da-95dc-9f48519bff54-delete_volume" acquired by "delete_volume" :: waited 0.137s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:33:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Acquiring lock "cinder-quobyte-de9b317f-6578-45da-95dc-9f48519bff54" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:33:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Lock "cinder-quobyte-de9b317f-6578-45da-95dc-9f48519bff54" acquired by "delete_volume" :: waited 0.033s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:33:51 devstack cinder-volume[86085]: INFO oslo.privsep.daemon [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpxs55438p/privsep.sock'] Sep 23 12:33:51 devstack sudo[87230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpxs55438p/privsep.sock Sep 23 12:33:51 devstack sudo[87230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:33:51 devstack cinder-volume[86085]: WARNING py.warnings [req-0ae158c2-473d-48bf-87fb-8d7d937313d4 req-2a948ca4-6c12-4196-9a93-46a7e38d32dd tempest-DeleteServersTestJSON-1157925965 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 23 12:33:51 devstack cinder-volume[86085]: .first() Sep 23 12:33:51 devstack cinder-volume[86085]: Sep 23 12:33:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-0ae158c2-473d-48bf-87fb-8d7d937313d4 req-2a948ca4-6c12-4196-9a93-46a7e38d32dd tempest-DeleteServersTestJSON-1157925965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:33:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-0ae158c2-473d-48bf-87fb-8d7d937313d4 req-2a948ca4-6c12-4196-9a93-46a7e38d32dd tempest-DeleteServersTestJSON-1157925965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:33:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-0ae158c2-473d-48bf-87fb-8d7d937313d4 req-2a948ca4-6c12-4196-9a93-46a7e38d32dd tempest-DeleteServersTestJSON-1157925965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:33:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-0ae158c2-473d-48bf-87fb-8d7d937313d4 req-2a948ca4-6c12-4196-9a93-46a7e38d32dd tempest-DeleteServersTestJSON-1157925965 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a442a84-0323-4ed3-9ea0-34265f9ac567', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:33:52 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-0ae158c2-473d-48bf-87fb-8d7d937313d4 req-2a948ca4-6c12-4196-9a93-46a7e38d32dd tempest-DeleteServersTestJSON-1157925965 None] attachment_update completed successfully. Sep 23 12:33:53 devstack cinder-volume[86085]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 23 12:33:53 devstack cinder-volume[86085]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 12:33:53 devstack cinder-volume[86085]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 23 12:33:53 devstack cinder-volume[86085]: WARNING oslo.privsep.daemon [-] privsep log: Sep 23 12:33:53 devstack cinder-volume[86085]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 23 12:33:53 devstack cinder-volume[86085]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 23 12:33:53 devstack cinder-volume[86085]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 12:33:53 devstack cinder-volume[86085]: WARNING oslo.privsep.daemon [-] privsep log: Sep 23 12:33:53 devstack cinder-volume[86085]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 23 12:33:54 devstack sudo[87230]: pam_unix(sudo:session): session closed for user root Sep 23 12:33:54 devstack cinder-volume[86085]: INFO oslo.privsep.daemon [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Spawned new privsep daemon via rootwrap Sep 23 12:33:54 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Accepted privsep connection to /tmp/tmpxs55438p/privsep.sock {{(pid=86085) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 23 12:33:54 devstack cinder-volume[86085]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 23 12:33:54 devstack cinder-volume[86085]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 23 12:33:54 devstack cinder-volume[86085]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 23 12:33:54 devstack cinder-volume[86085]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87649 Sep 23 12:33:54 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[59769669-3fb4-4583-9e8b-e6d1fa40d394]: (2,) {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:33:54 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5db607-64e5-45eb-b024-c1fb037d055a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:33:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-de9b317f-6578-45da-95dc-9f48519bff54 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:33:54 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-de9b317f-6578-45da-95dc-9f48519bff54 Sep 23 12:33:54 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:33:55 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Sep 23 12:33:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-de9b317f-6578-45da-95dc-9f48519bff54" returned: 0 in 0.972s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:33:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-de9b317f-6578-45da-95dc-9f48519bff54 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:33:55 devstack sudo[87677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-de9b317f-6578-45da-95dc-9f48519bff54 Sep 23 12:33:55 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:33:55 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root Sep 23 12:33:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-de9b317f-6578-45da-95dc-9f48519bff54" returned: 0 in 0.528s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:33:55 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Lock "cinder-quobyte-de9b317f-6578-45da-95dc-9f48519bff54" released by "delete_volume" :: held 4.727s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:33:55 devstack cinder-volume[86085]: WARNING cinder.quota [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:33:55 devstack cinder-volume[86085]: WARNING cinder.quota [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:33:55 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Created reservations ['57462bd1-21d1-4310-ae26-cfc338713ce4', '15b1045d-8126-4907-811b-b00db2ecf1f4', '8afbfb11-3844-4dcd-b8a7-bc26089d06d8', 'c6dbaadd-0b5d-499c-a55a-49006c7969ba'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:33:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:33:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:33:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:33:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:33:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:33:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:33:56 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:33:56 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:33:57 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Sep 23 12:33:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.698s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:33:57 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:33:57 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Deleted volume successfully. Sep 23 12:33:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4d71773c-f6fe-4c0b-9bb3-92de37ba3809 tempest-VolumesAdminNegativeTest-1983485800 None] Lock "cinder-de9b317f-6578-45da-95dc-9f48519bff54-delete_volume" released by "delete_volume" :: held 6.542s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:33:58 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-7670b6dc-bebd-472f-bf64-223160bfb921 req-5d91cc6b-85ce-4b84-bd50-8ecd115ef0cf tempest-DeleteServersTestJSON-1157925965 None] Terminate volume connection completed successfully. Sep 23 12:33:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-7670b6dc-bebd-472f-bf64-223160bfb921 req-5d91cc6b-85ce-4b84-bd50-8ecd115ef0cf tempest-DeleteServersTestJSON-1157925965 None] Deleting attachment 2a442a84-0323-4ed3-9ea0-34265f9ac567. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:34:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] Acquiring lock "cinder-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:34:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] Lock "cinder-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:34:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] Acquiring lock "cinder-quobyte-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:34:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] Lock "cinder-quobyte-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a" acquired by "delete_volume" :: waited 0.015s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:34:01 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0560b513-751b-4ee6-b747-e09ff2f39620]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:34:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:34:01 devstack sudo[87794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a Sep 23 12:34:01 devstack sudo[87794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:34:01 devstack sudo[87794]: pam_unix(sudo:session): session closed for user root Sep 23 12:34:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a" returned: 0 in 0.447s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:34:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:34:01 devstack sudo[87799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a Sep 23 12:34:01 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:34:02 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root Sep 23 12:34:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a" returned: 0 in 0.298s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:34:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] Lock "cinder-quobyte-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a" released by "delete_volume" :: held 0.797s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:34:02 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] Created reservations ['b240222a-d602-45b7-8714-382ebd5c300c', '730f3045-c4f3-4f8b-bebd-a44f705aebc2', 'e824ba65-2d7b-44eb-bcd1-c9589a8fd2d9', '6983b0cf-8d77-4970-9ae4-82a90fa27964'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:34:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:34:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:34:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:34:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:34:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:34:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:34:02 devstack sudo[87802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:34:02 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:34:02 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root Sep 23 12:34:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.311s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:34:02 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:34:02 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] Deleted volume successfully. Sep 23 12:34:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4d6164cd-d571-4bf7-bf46-9e6ecb6010eb tempest-DeleteServersTestJSON-1157925965 None] Lock "cinder-b28e56e2-ca04-4cd4-ad48-b7526e4b4f3a-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=16,cinder:INSERT=5,cinder:UPDATE=24,cinder:DELETE=3 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Flow 'volume_create_manager' (6236bef4-b4ce-4484-b0f2-0c0da46cefb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cd5318-7429-4c4b-bfe9-21e606a00994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cd5318-7429-4c4b-bfe9-21e606a00994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1357194557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3505bb89-02c7-4fd4-b9fc-a9af14485017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da1c9cb78b47f1b67ec41a8a5c1feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:34:12Z,use_quota=True,user_id='1be5f5cab17b4445a6646d9b2ab0ba02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c37261-85a3-4ad4-8cfa-051f776364bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c37261-85a3-4ad4-8cfa-051f776364bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36af2ac0-9816-495f-9176-5f595be73209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36af2ac0-9816-495f-9176-5f595be73209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3505bb89-02c7-4fd4-b9fc-a9af14485017', 'volume_name': 'volume-3505bb89-02c7-4fd4-b9fc-a9af14485017', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91364ed-7516-41e9-a85d-c58c3f4391fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91364ed-7516-41e9-a85d-c58c3f4391fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (733a6841-1650-4753-b9ac-0320a20cbf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:34:12 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Volume 3505bb89-02c7-4fd4-b9fc-a9af14485017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3505bb89-02c7-4fd4-b9fc-a9af14485017', 'volume_size': 1} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1357194557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3505bb89-02c7-4fd4-b9fc-a9af14485017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da1c9cb78b47f1b67ec41a8a5c1feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:34:12Z,use_quota=True,user_id='1be5f5cab17b4445a6646d9b2ab0ba02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Creating volume 3505bb89-02c7-4fd4-b9fc-a9af14485017 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:34:12 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:34:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3505bb89-02c7-4fd4-b9fc-a9af14485017 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:34:12 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3505bb89-02c7-4fd4-b9fc-a9af14485017 1073741824 Sep 23 12:34:12 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:34:13 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Sep 23 12:34:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3505bb89-02c7-4fd4-b9fc-a9af14485017 1073741824" returned: 0 in 0.644s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:34:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3505bb89-02c7-4fd4-b9fc-a9af14485017 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:34:13 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3505bb89-02c7-4fd4-b9fc-a9af14485017 Sep 23 12:34:13 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:34:13 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Sep 23 12:34:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3505bb89-02c7-4fd4-b9fc-a9af14485017" returned: 0 in 0.437s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:34:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:34:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:34:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (733a6841-1650-4753-b9ac-0320a20cbf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3505bb89-02c7-4fd4-b9fc-a9af14485017', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:34:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236e0090-7c19-4a35-8153-ea2f530d9659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:34:13 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Volume volume-3505bb89-02c7-4fd4-b9fc-a9af14485017 (3505bb89-02c7-4fd4-b9fc-a9af14485017): created successfully Sep 23 12:34:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236e0090-7c19-4a35-8153-ea2f530d9659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:34:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Flow 'volume_create_manager' (6236bef4-b4ce-4484-b0f2-0c0da46cefb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:34:13 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f232d5fb-73ae-45e1-a788-ca03172aad52 tempest-ServerActionsTestOtherA-832026328 None] Created volume successfully. Sep 23 12:34:23 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:34:23 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=27,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:34:37 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:34:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:34:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:34:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:34:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:34:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:34:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:34:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:34:41 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:34:41 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:34:41 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Sep 23 12:34:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.333s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:34:41 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Flow 'volume_create_manager' (62606f17-a7a1-420c-a1bb-da4b36b35120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e9db8a-bdfd-4a90-977a-f429a2ae4622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e9db8a-bdfd-4a90-977a-f429a2ae4622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-177305885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb703b52-2000-4ca0-b580-af64bd07bf4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80e1e6c2c358454ca19c76a81f84b724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:35:06Z,use_quota=True,user_id='7b3c917344774764bd5571462f1fec1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d8210d-74ba-4172-ad04-094dac6db77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d8210d-74ba-4172-ad04-094dac6db77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e1d7ee-a8ea-4f27-bd10-1f30e4c2e0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e1d7ee-a8ea-4f27-bd10-1f30e4c2e0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb703b52-2000-4ca0-b580-af64bd07bf4b', 'volume_name': 'volume-cb703b52-2000-4ca0-b580-af64bd07bf4b', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e3850d-c31a-4972-887f-79715ad5331d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e3850d-c31a-4972-887f-79715ad5331d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c73a40a6-3c28-4af2-b4d3-784344fb898a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:35:05 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Volume cb703b52-2000-4ca0-b580-af64bd07bf4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb703b52-2000-4ca0-b580-af64bd07bf4b', 'volume_size': 1} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-177305885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb703b52-2000-4ca0-b580-af64bd07bf4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80e1e6c2c358454ca19c76a81f84b724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:35:06Z,use_quota=True,user_id='7b3c917344774764bd5571462f1fec1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Creating volume cb703b52-2000-4ca0-b580-af64bd07bf4b {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:35:05 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:35:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cb703b52-2000-4ca0-b580-af64bd07bf4b 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:35:05 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cb703b52-2000-4ca0-b580-af64bd07bf4b 1073741824 Sep 23 12:35:05 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:35:06 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Sep 23 12:35:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cb703b52-2000-4ca0-b580-af64bd07bf4b 1073741824" returned: 0 in 0.872s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:35:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cb703b52-2000-4ca0-b580-af64bd07bf4b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:35:06 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cb703b52-2000-4ca0-b580-af64bd07bf4b Sep 23 12:35:06 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:35:07 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Sep 23 12:35:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cb703b52-2000-4ca0-b580-af64bd07bf4b" returned: 0 in 0.542s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:35:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:35:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:35:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c73a40a6-3c28-4af2-b4d3-784344fb898a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb703b52-2000-4ca0-b580-af64bd07bf4b', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:35:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39636a3e-d81c-489c-a8d4-74bbad19ff17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:35:07 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Volume volume-cb703b52-2000-4ca0-b580-af64bd07bf4b (cb703b52-2000-4ca0-b580-af64bd07bf4b): created successfully Sep 23 12:35:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39636a3e-d81c-489c-a8d4-74bbad19ff17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:35:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Flow 'volume_create_manager' (62606f17-a7a1-420c-a1bb-da4b36b35120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:35:07 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-a31ef9ae-5037-4567-9d78-7cf1fbf79c55 tempest-ServerRescueNegativeTestJSON-771727154 None] Created volume successfully. Sep 23 12:35:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-3c258097-1a07-43b6-a348-24dfc5ea7c55 req-d80d92e5-481a-47da-b985-00046855a016 tempest-ServerActionsTestOtherA-832026328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:35:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-3c258097-1a07-43b6-a348-24dfc5ea7c55 req-d80d92e5-481a-47da-b985-00046855a016 tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:35:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-3c258097-1a07-43b6-a348-24dfc5ea7c55 req-d80d92e5-481a-47da-b985-00046855a016 tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:35:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-3c258097-1a07-43b6-a348-24dfc5ea7c55 req-d80d92e5-481a-47da-b985-00046855a016 tempest-ServerActionsTestOtherA-832026328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-3505bb89-02c7-4fd4-b9fc-a9af14485017', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c80040b9-5947-49e9-adba-7070d34c68ab', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:35:10 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-3c258097-1a07-43b6-a348-24dfc5ea7c55 req-d80d92e5-481a-47da-b985-00046855a016 tempest-ServerActionsTestOtherA-832026328 None] attachment_update completed successfully. Sep 23 12:35:18 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-b7d22261-5aa8-41eb-836f-c49c7477da69 req-be9d0011-4f58-425b-84f3-adf46e85ee13 tempest-ServerActionsTestOtherA-832026328 None] Terminate volume connection completed successfully. Sep 23 12:35:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-b7d22261-5aa8-41eb-836f-c49c7477da69 req-be9d0011-4f58-425b-84f3-adf46e85ee13 tempest-ServerActionsTestOtherA-832026328 None] Deleting attachment c80040b9-5947-49e9-adba-7070d34c68ab. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:35:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-b7d22261-5aa8-41eb-836f-c49c7477da69 req-88af50da-4f32-4c8b-9ef2-eedabee60586 tempest-ServerActionsTestOtherA-832026328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:35:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-b7d22261-5aa8-41eb-836f-c49c7477da69 req-88af50da-4f32-4c8b-9ef2-eedabee60586 tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:35:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-b7d22261-5aa8-41eb-836f-c49c7477da69 req-88af50da-4f32-4c8b-9ef2-eedabee60586 tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.062s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:35:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-b7d22261-5aa8-41eb-836f-c49c7477da69 req-88af50da-4f32-4c8b-9ef2-eedabee60586 tempest-ServerActionsTestOtherA-832026328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-3505bb89-02c7-4fd4-b9fc-a9af14485017', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '841014b2-7b16-47fb-b7f9-3a4a75a0f7f7', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:35:20 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-b7d22261-5aa8-41eb-836f-c49c7477da69 req-88af50da-4f32-4c8b-9ef2-eedabee60586 tempest-ServerActionsTestOtherA-832026328 None] attachment_update completed successfully. Sep 23 12:35:28 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] Acquiring lock "cinder-cb703b52-2000-4ca0-b580-af64bd07bf4b-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:35:28 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] Lock "cinder-cb703b52-2000-4ca0-b580-af64bd07bf4b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:35:29 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] Acquiring lock "cinder-quobyte-cb703b52-2000-4ca0-b580-af64bd07bf4b" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:35:29 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] Lock "cinder-quobyte-cb703b52-2000-4ca0-b580-af64bd07bf4b" acquired by "delete_volume" :: waited 0.038s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:35:29 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacc6225-b843-40dc-a9f0-aad43084e727]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:35:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cb703b52-2000-4ca0-b580-af64bd07bf4b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:35:29 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cb703b52-2000-4ca0-b580-af64bd07bf4b Sep 23 12:35:29 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:35:29 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Sep 23 12:35:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cb703b52-2000-4ca0-b580-af64bd07bf4b" returned: 0 in 0.686s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:35:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cb703b52-2000-4ca0-b580-af64bd07bf4b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:35:29 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cb703b52-2000-4ca0-b580-af64bd07bf4b Sep 23 12:35:29 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:35:30 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cb703b52-2000-4ca0-b580-af64bd07bf4b" returned: 0 in 0.442s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] Lock "cinder-quobyte-cb703b52-2000-4ca0-b580-af64bd07bf4b" released by "delete_volume" :: held 1.231s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Flow 'volume_create_manager' (64094671-0d58-4109-b4f3-7f8fb4dbb1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74d4b36-98cc-4e78-820b-f71a5043653c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74d4b36-98cc-4e78-820b-f71a5043653c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1345934323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=077a7ab7-f650-4130-9a9b-408be55b404d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964bfc017b45493ea1f760426821c92d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:35:30Z,use_quota=True,user_id='007347b285fa4e11a7646215695c6011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21dd3fed-3f29-41f3-968c-0c0d1c6ec376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21dd3fed-3f29-41f3-968c-0c0d1c6ec376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63807a6-f44e-46c8-a346-5be7779edd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63807a6-f44e-46c8-a346-5be7779edd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '077a7ab7-f650-4130-9a9b-408be55b404d', 'volume_name': 'volume-077a7ab7-f650-4130-9a9b-408be55b404d', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0adb90bc-5d8d-4095-aa8a-5933b8474e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0adb90bc-5d8d-4095-aa8a-5933b8474e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c002d9b-b9c0-416d-a001-e2584cea44c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:35:30 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Volume 077a7ab7-f650-4130-9a9b-408be55b404d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-077a7ab7-f650-4130-9a9b-408be55b404d', 'volume_size': 1} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1345934323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=077a7ab7-f650-4130-9a9b-408be55b404d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964bfc017b45493ea1f760426821c92d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:35:30Z,use_quota=True,user_id='007347b285fa4e11a7646215695c6011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Creating volume 077a7ab7-f650-4130-9a9b-408be55b404d {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:35:30 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-077a7ab7-f650-4130-9a9b-408be55b404d 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:35:30 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-077a7ab7-f650-4130-9a9b-408be55b404d 1073741824 Sep 23 12:35:30 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] Created reservations ['3db272cc-0a05-41ea-be21-25ad026ab143', '092ea049-1270-4d96-b683-b70aa0988b8e', '4525c4da-ba58-479f-a873-e1a99b575628', 'cd16cf90-ec16-44cb-9b32-cadcc48c420d'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:35:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:35:30 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:35:30 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:35:31 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Sep 23 12:35:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.312s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:35:31 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:35:31 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] Deleted volume successfully. Sep 23 12:35:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e2b943ef-59c5-4151-9b70-3a0dce7ccaf2 tempest-ServerRescueNegativeTestJSON-771727154 None] Lock "cinder-cb703b52-2000-4ca0-b580-af64bd07bf4b-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:35:31 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Sep 23 12:35:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-077a7ab7-f650-4130-9a9b-408be55b404d 1073741824" returned: 0 in 0.724s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:35:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-077a7ab7-f650-4130-9a9b-408be55b404d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:35:31 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-077a7ab7-f650-4130-9a9b-408be55b404d Sep 23 12:35:31 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:35:31 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Sep 23 12:35:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-077a7ab7-f650-4130-9a9b-408be55b404d" returned: 0 in 0.405s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:35:31 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:35:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:35:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c002d9b-b9c0-416d-a001-e2584cea44c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-077a7ab7-f650-4130-9a9b-408be55b404d', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:35:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ae4af5-9190-4e45-ab03-8f2a273ef514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:35:31 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Volume volume-077a7ab7-f650-4130-9a9b-408be55b404d (077a7ab7-f650-4130-9a9b-408be55b404d): created successfully Sep 23 12:35:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ae4af5-9190-4e45-ab03-8f2a273ef514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:35:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Flow 'volume_create_manager' (64094671-0d58-4109-b4f3-7f8fb4dbb1d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:35:31 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ca0abf3a-4304-4880-98e2-9d5b3505c39c tempest-TaggedAttachmentsTest-2125258503 None] Created volume successfully. Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Flow 'volume_create_manager' (3f8ddea3-7731-4a85-9182-1a97a4dec545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86fb3938-c78f-409d-80f3-b4f3f1576ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86fb3938-c78f-409d-80f3-b4f3f1576ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1125070495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785ef3641f524525afec67674c8e0917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:35:37Z,use_quota=True,user_id='4e6bd877477546f697080e8e05c20c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a374af-38ca-4c44-86a0-80b876a9b378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a374af-38ca-4c44-86a0-80b876a9b378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e47ace-0cf5-4a74-8195-0e362571ff4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e47ace-0cf5-4a74-8195-0e362571ff4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35', 'volume_name': 'volume-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47508de7-fd11-473d-bd87-8dadea15d7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47508de7-fd11-473d-bd87-8dadea15d7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5a433d-b89f-44e4-a05c-994ef81f545a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:35:36 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Volume b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35', 'volume_size': 1} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1125070495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785ef3641f524525afec67674c8e0917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:35:37Z,use_quota=True,user_id='4e6bd877477546f697080e8e05c20c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Creating volume b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:35:36 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:35:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:35:36 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35 1073741824 Sep 23 12:35:36 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:35:37 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Sep 23 12:35:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35 1073741824" returned: 0 in 0.686s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:35:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:35:37 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35 Sep 23 12:35:37 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:35:38 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Sep 23 12:35:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35" returned: 0 in 0.386s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:35:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:35:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:35:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5a433d-b89f-44e4-a05c-994ef81f545a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:35:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7d64e1-0a01-4654-ad29-02d6613318f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:35:38 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Volume volume-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35 (b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35): created successfully Sep 23 12:35:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7d64e1-0a01-4654-ad29-02d6613318f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:35:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Flow 'volume_create_manager' (3f8ddea3-7731-4a85-9182-1a97a4dec545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:35:38 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d0d2a11e-5f43-4e95-b4b9-9931a76896e1 tempest-AttachVolumeShelveTestJSON-1645559046 None] Created volume successfully. Sep 23 12:35:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:35:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:35:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:35:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:35:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:35:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:35:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:35:41 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:35:41 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:35:41 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Sep 23 12:35:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.581s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:35:41 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:35:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:35:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 8 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:35:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:35:48 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=22,cinder:UPDATE=14,cinder:DELETE=3,cinder:INSERT=4 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:35:48 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:UPDATE=26,cinder:SELECT=28,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:35:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9fd4220f-e578-4e78-917c-8f293e558461 tempest-BackendsCapabilitiesAdminTestsJSON-259794993 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4653587341309, 'free_capacity_gb': 1775.4653587341309, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86085) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 12:35:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4c3225fe-cb67-472e-b0ae-e0c47a6bfdee tempest-BackendsCapabilitiesAdminTestsJSON-259794993 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4653587341309, 'free_capacity_gb': 1775.4653587341309, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86085) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 12:35:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-b18fe377-f0cf-40e9-a44b-03de83d826e4 req-56bfb019-1354-4212-b6b1-da40ef7e1454 tempest-AttachVolumeShelveTestJSON-1645559046 None] No connector for attachment 007776b7-5bc2-441a-84c2-4c00da22d820; skipping storage backend terminate_connection call. {{(pid=86085) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 23 12:35:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-b18fe377-f0cf-40e9-a44b-03de83d826e4 req-56bfb019-1354-4212-b6b1-da40ef7e1454 tempest-AttachVolumeShelveTestJSON-1645559046 None] Deleting attachment 007776b7-5bc2-441a-84c2-4c00da22d820. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:35:57 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-2e39749f-5e66-4cae-a267-f73e08128ce3 req-2b7d67ec-00c5-4e5d-a802-4f615e49b621 tempest-ServerActionsTestOtherA-832026328 None] Terminate volume connection completed successfully. Sep 23 12:35:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-2e39749f-5e66-4cae-a267-f73e08128ce3 req-2b7d67ec-00c5-4e5d-a802-4f615e49b621 tempest-ServerActionsTestOtherA-832026328 None] Deleting attachment 841014b2-7b16-47fb-b7f9-3a4a75a0f7f7. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:36:07 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=2 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:36:07 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=2 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:36:07 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:36:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Flow 'volume_create_manager' (02aeea95-5bd4-4f49-8214-66f4cd058022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:36:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cae322a-baf0-4c17-a3b1-81e382861af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:36:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cae322a-baf0-4c17-a3b1-81e382861af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1319134635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357095d2-a379-4ab1-8b38-5a32a2c1839f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da1c9cb78b47f1b67ec41a8a5c1feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:36:08Z,use_quota=True,user_id='1be5f5cab17b4445a6646d9b2ab0ba02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:36:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b63149c-6a1e-48a1-b027-d4961898825b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:36:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b63149c-6a1e-48a1-b027-d4961898825b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:36:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15a98c6-08ba-44e2-becd-e2bbbdb19423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:36:07 devstack cinder-volume[86085]: DEBUG cinder.image.glance [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Creating Keystone auth plugin from conf {{(pid=86085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 12:36:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15a98c6-08ba-44e2-becd-e2bbbdb19423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '357095d2-a379-4ab1-8b38-5a32a2c1839f', 'volume_name': 'volume-357095d2-a379-4ab1-8b38-5a32a2c1839f', 'volume_size': 1, 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3c5121b794a4715babb77a8b7da12a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'created_at': datetime.datetime(2026, 9, 23, 10, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 27, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:36:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235ff254-62b1-45d8-b827-61f5228b7897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:36:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235ff254-62b1-45d8-b827-61f5228b7897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:36:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e39923e-206e-400c-927f-b2a3387690d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:36:08 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Volume 357095d2-a379-4ab1-8b38-5a32a2c1839f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-357095d2-a379-4ab1-8b38-5a32a2c1839f', 'volume_size': 1, 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3c5121b794a4715babb77a8b7da12a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'created_at': datetime.datetime(2026, 9, 23, 10, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 27, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 12:36:08 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Trying to clone 357095d2-a379-4ab1-8b38-5a32a2c1839f from image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]). {{(pid=86085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 12:36:09 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_dk4uxgbcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 12:36:09 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Image download 20.69 MB at 20.69 MB/s Sep 23 12:36:09 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f125f2-e91a-4df3-ae4d-848d6610d513]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:36:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_dk4uxgbcdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:09 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_dk4uxgbcdevstack@QuobyteHD Sep 23 12:36:09 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:10 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_dk4uxgbcdevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:10 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Temporary image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 is fetched for user 1be5f5cab17b4445a6646d9b2ab0ba02. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 12:36:10 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[346c1c5e-3c6f-4a06-beab-004545231693]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:36:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_dk4uxgbcdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:10 devstack sudo[89984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_dk4uxgbcdevstack@QuobyteHD Sep 23 12:36:10 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:10 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_dk4uxgbcdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:36:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:36:10 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1319134635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357095d2-a379-4ab1-8b38-5a32a2c1839f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da1c9cb78b47f1b67ec41a8a5c1feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:36:08Z,use_quota=True,user_id='1be5f5cab17b4445a6646d9b2ab0ba02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:36:10 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Creating volume 357095d2-a379-4ab1-8b38-5a32a2c1839f {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:36:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:36:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:36:10 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:36:10 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:36:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:36:10 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:36:10 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:36:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-357095d2-a379-4ab1-8b38-5a32a2c1839f 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:10 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-357095d2-a379-4ab1-8b38-5a32a2c1839f 1073741824 Sep 23 12:36:10 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:11 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-357095d2-a379-4ab1-8b38-5a32a2c1839f 1073741824" returned: 0 in 0.803s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-357095d2-a379-4ab1-8b38-5a32a2c1839f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:11 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-357095d2-a379-4ab1-8b38-5a32a2c1839f Sep 23 12:36:11 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:12 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-357095d2-a379-4ab1-8b38-5a32a2c1839f" returned: 0 in 0.382s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:36:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:36:12 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Attempting download of 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}])) to volume 357095d2-a379-4ab1-8b38-5a32a2c1839f. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 12:36:12 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f82a5e-2e49-4e32-a426-68a6d539afe9]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:36:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_nhxt483n {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:12 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_nhxt483n Sep 23 12:36:12 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:12 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_nhxt483n" returned: 0 in 0.337s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_nhxt483n {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:12 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_nhxt483n Sep 23 12:36:12 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:12 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_nhxt483n" returned: 1 in 0.383s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_nhxt483n' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:36:12 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f026107-d494-44f2-bb7b-84c4c9bd55c2]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:36:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_dk4uxgbcdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:12 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_dk4uxgbcdevstack@QuobyteHD Sep 23 12:36:12 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:13 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_dk4uxgbcdevstack@QuobyteHD" returned: 0 in 0.516s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:13 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 was qcow2, converting to qcow2 {{(pid=86085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 12:36:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_dk4uxgbcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-357095d2-a379-4ab1-8b38-5a32a2c1839f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:13 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_dk4uxgbcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-357095d2-a379-4ab1-8b38-5a32a2c1839f Sep 23 12:36:13 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:13 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ad57c4dc-25c9-433a-834d-7d53082e4bb7 tempest-GroupsV314Test-1963616199 None] Group tempest-GroupsV314Test-Group-1987978909: creating Sep 23 12:36:13 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ad57c4dc-25c9-433a-834d-7d53082e4bb7 tempest-GroupsV314Test-1963616199 None] Group tempest-GroupsV314Test-Group-1987978909: created successfully Sep 23 12:36:13 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ad57c4dc-25c9-433a-834d-7d53082e4bb7 tempest-GroupsV314Test-1963616199 None] Create group completed successfully. Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Flow 'volume_create_manager' (4bd3a960-2623-45f0-af03-0baf301378e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29adef4-8907-4769-b31c-8979fee0efad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29adef4-8907-4769-b31c-8979fee0efad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1406331994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f4b1bb1-a021-478c-b29d-9cca540c9dfc,host='devstack@QuobyteHD#QuobyteHD',id=7c0efe6f-8857-4b6c-a316-cebe0f21c15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d1cbadb7a64450baefbad6fe75e9332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:36:16Z,use_quota=True,user_id='fce497a3fa98417f870f60016f451a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50a68f3f-bd7e-40c2-8409-6f15ec638fa0),volume_type_id=50a68f3f-bd7e-40c2-8409-6f15ec638fa0)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f05f93-c7f4-4139-9d51-63e8e344e93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f05f93-c7f4-4139-9d51-63e8e344e93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeeca97e-fc8e-405f-899a-1e82ee407955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeeca97e-fc8e-405f-899a-1e82ee407955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c0efe6f-8857-4b6c-a316-cebe0f21c15e', 'volume_name': 'volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfae7520-fb7b-4bb2-a35b-1ca4e64e7bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfae7520-fb7b-4bb2-a35b-1ca4e64e7bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b256aa-ace3-4556-bf6b-703a3bf935ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:36:15 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Volume 7c0efe6f-8857-4b6c-a316-cebe0f21c15e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e', 'volume_size': 1} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5f4b1bb1-a021-478c-b29d-9cca540c9dfc,created_at=2026-09-23T10:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1406331994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f4b1bb1-a021-478c-b29d-9cca540c9dfc,host='devstack@QuobyteHD#QuobyteHD',id=7c0efe6f-8857-4b6c-a316-cebe0f21c15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d1cbadb7a64450baefbad6fe75e9332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:36:16Z,use_quota=True,user_id='fce497a3fa98417f870f60016f451a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50a68f3f-bd7e-40c2-8409-6f15ec638fa0),volume_type_id=50a68f3f-bd7e-40c2-8409-6f15ec638fa0)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Creating volume 7c0efe6f-8857-4b6c-a316-cebe0f21c15e {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:36:15 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:15 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e 1073741824 Sep 23 12:36:15 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:15 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_dk4uxgbcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-357095d2-a379-4ab1-8b38-5a32a2c1839f" returned: 0 in 2.598s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_dk4uxgbcdevstack@QuobyteHD, size 112.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-357095d2-a379-4ab1-8b38-5a32a2c1839f {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:36:15 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Converted 112.00 MB image at 43.08 MB/s Sep 23 12:36:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-357095d2-a379-4ab1-8b38-5a32a2c1839f 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:16 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-357095d2-a379-4ab1-8b38-5a32a2c1839f 1G Sep 23 12:36:16 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:16 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-357095d2-a379-4ab1-8b38-5a32a2c1839f 1G" returned: 0 in 0.353s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:16 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Downloaded image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}])) to volume 357095d2-a379-4ab1-8b38-5a32a2c1839f successfully. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 12:36:16 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Temporary image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 for user 1be5f5cab17b4445a6646d9b2ab0ba02 is deleted. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 12:36:16 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Marking volume 357095d2-a379-4ab1-8b38-5a32a2c1839f as bootable. {{(pid=86085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 12:36:16 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Copying metadata from image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 to 357095d2-a379-4ab1-8b38-5a32a2c1839f. {{(pid=86085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 12:36:16 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Creating volume glance metadata for volume 357095d2-a379-4ab1-8b38-5a32a2c1839f backed by image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 12:36:16 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e 1073741824" returned: 0 in 0.587s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e39923e-206e-400c-927f-b2a3387690d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-357095d2-a379-4ab1-8b38-5a32a2c1839f', 'volume_size': 1, 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3c5121b794a4715babb77a8b7da12a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'created_at': datetime.datetime(2026, 9, 23, 10, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 27, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:36:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3a69d0-a0c9-442b-a7d7-e3cc20dafe7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:36:16 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Volume volume-357095d2-a379-4ab1-8b38-5a32a2c1839f (357095d2-a379-4ab1-8b38-5a32a2c1839f): created successfully Sep 23 12:36:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3a69d0-a0c9-442b-a7d7-e3cc20dafe7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:36:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Flow 'volume_create_manager' (02aeea95-5bd4-4f49-8214-66f4cd058022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:36:16 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d44f2998-df61-4b88-8e25-1c7497fbe4e8 tempest-ServerActionsTestOtherA-832026328 None] Created volume successfully. Sep 23 12:36:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:16 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e Sep 23 12:36:16 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:16 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e" returned: 0 in 0.281s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:36:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:36:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b256aa-ace3-4556-bf6b-703a3bf935ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:36:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8454cc01-079e-4bc2-9ee8-c2edce7cf616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:36:17 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Volume volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e (7c0efe6f-8857-4b6c-a316-cebe0f21c15e): created successfully Sep 23 12:36:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8454cc01-079e-4bc2-9ee8-c2edce7cf616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:36:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Flow 'volume_create_manager' (4bd3a960-2623-45f0-af03-0baf301378e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:36:17 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-be268fa8-09fc-4173-858d-aea54431b262 tempest-GroupsV314Test-1963616199 None] Created volume successfully. Sep 23 12:36:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:36:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:36:19 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Cloning volume 7c0efe6f-8857-4b6c-a316-cebe0f21c15e to volume 83de53e1-4d5a-43f1-802c-3f6997888b92 Sep 23 12:36:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Creating offline snapshot dd50120d-19f7-4898-b192-d03c4a3482fd of volume 7c0efe6f-8857-4b6c-a316-cebe0f21c15e {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:36:19 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acbcc22-71e7-4296-a0f6-10dd8b0b1e4c]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:36:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:20 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e Sep 23 12:36:20 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-01dfbaa4-6c1b-44fa-8c30-064593c2071e req-72ec3160-f5b2-4d42-b5bc-5dd8191ef07b tempest-TaggedAttachmentsTest-2125258503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:36:20 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e" returned: 0 in 0.656s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:20 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd 1G Sep 23 12:36:20 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:21 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd 1G" returned: 0 in 0.559s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:21 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd Sep 23 12:36:21 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:21 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd" returned: 0 in 0.388s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:21 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd is being set with open permissions: ugo+rw: NotImplementedError Sep 23 12:36:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:21 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd Sep 23 12:36:21 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:21 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd" returned: 0 in 0.363s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:22 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.info Sep 23 12:36:22 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:22 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.info" returned: 0 in 0.385s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:22 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 12:36:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:22 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.info Sep 23 12:36:22 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-b92f5cd9-0e62-43c5-8a0a-68f7626d9732 req-d30f3775-80a9-4e70-808f-be3d22e32d4e tempest-ServerActionsTestOtherA-832026328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:36:22 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.info" returned: 0 in 0.388s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Acquiring lock "cinder-quobyte-83de53e1-4d5a-43f1-802c-3f6997888b92" by "_copy_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:36:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Lock "cinder-quobyte-83de53e1-4d5a-43f1-802c-3f6997888b92" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:36:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] snapshot: dd50120d-19f7-4898-b192-d03c4a3482fd, volume: 83de53e1-4d5a-43f1-802c-3f6997888b92, {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 12:36:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:36:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:36:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:36:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:36:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:36:22 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af7b02a-9866-437a-a2ea-4b1a980cf289]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:36:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:23 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd Sep 23 12:36:23 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:23 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd" returned: 0 in 0.567s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:36:23 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[61be2075-3403-421f-bc80-7bede08115c0]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:36:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:23 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e Sep 23 12:36:23 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:23 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e" returned: 0 in 0.448s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] will copy from snapshot at /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 12:36:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Creating direct copy from snapshot {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 12:36:23 devstack cinder-volume[86085]: DEBUG cinder.utils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Path /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83de53e1-4d5a-43f1-802c-3f6997888b92 not found in is_blk_device check {{(pid=86085) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 12:36:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83de53e1-4d5a-43f1-802c-3f6997888b92 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:23 devstack sudo[90164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83de53e1-4d5a-43f1-802c-3f6997888b92 Sep 23 12:36:23 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:31 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83de53e1-4d5a-43f1-802c-3f6997888b92" returned: 0 in 7.244s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:31 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Image conversion details: src /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e, size 1024.00 MB, duration 7.25 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83de53e1-4d5a-43f1-802c-3f6997888b92 {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:36:31 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Converted 1024.00 MB image at 141.34 MB/s Sep 23 12:36:31 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83de53e1-4d5a-43f1-802c-3f6997888b92 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 12:36:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83de53e1-4d5a-43f1-802c-3f6997888b92 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:31 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83de53e1-4d5a-43f1-802c-3f6997888b92 Sep 23 12:36:31 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:31 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83de53e1-4d5a-43f1-802c-3f6997888b92" returned: 0 in 0.247s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Lock "cinder-quobyte-83de53e1-4d5a-43f1-802c-3f6997888b92" released by "_copy_volume_from_snapshot" :: held 8.589s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:36:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Acquiring lock "cinder-quobyte-dd50120d-19f7-4898-b192-d03c4a3482fd" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:36:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Lock "cinder-quobyte-dd50120d-19f7-4898-b192-d03c4a3482fd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:36:31 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Deleting offline snapshot dd50120d-19f7-4898-b192-d03c4a3482fd of volume 7c0efe6f-8857-4b6c-a316-cebe0f21c15e {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:36:31 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] snapshot_file for this snap is: volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:36:31 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[5354157c-4cd7-465b-b6af-511052929fbf]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:36:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:31 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd Sep 23 12:36:31 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:31 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd" returned: 0 in 0.419s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:31 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:36:31 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d082392-5ceb-491c-9e7c-61ee254a7069]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:36:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:32 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e Sep 23 12:36:32 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:32 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e" returned: 0 in 0.535s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:32 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd Sep 23 12:36:32 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:32 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd" returned: 0 in 0.341s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:32 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd Sep 23 12:36:32 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:33 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e.dd50120d-19f7-4898-b192-d03c4a3482fd" returned: 0 in 0.246s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Lock "cinder-quobyte-dd50120d-19f7-4898-b192-d03c4a3482fd" released by "_delete_snapshot" :: held 1.652s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:36:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.281s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:36:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-01dfbaa4-6c1b-44fa-8c30-064593c2071e req-72ec3160-f5b2-4d42-b5bc-5dd8191ef07b tempest-TaggedAttachmentsTest-2125258503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.544s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:36:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-01dfbaa4-6c1b-44fa-8c30-064593c2071e req-72ec3160-f5b2-4d42-b5bc-5dd8191ef07b tempest-TaggedAttachmentsTest-2125258503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:36:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-b92f5cd9-0e62-43c5-8a0a-68f7626d9732 req-d30f3775-80a9-4e70-808f-be3d22e32d4e tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.562s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:36:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-b92f5cd9-0e62-43c5-8a0a-68f7626d9732 req-d30f3775-80a9-4e70-808f-be3d22e32d4e tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.093s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:36:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-01dfbaa4-6c1b-44fa-8c30-064593c2071e req-72ec3160-f5b2-4d42-b5bc-5dd8191ef07b tempest-TaggedAttachmentsTest-2125258503 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-077a7ab7-f650-4130-9a9b-408be55b404d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '145367ae-771b-46d6-a641-5599a7940129', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:36:33 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0958f9f6-6f6e-41f4-a7e2-fa01334d0899 tempest-GroupsV314Test-1963616199 None] Create group from source-group-5f4b1bb1-a021-478c-b29d-9cca540c9dfc completed successfully. Sep 23 12:36:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-b92f5cd9-0e62-43c5-8a0a-68f7626d9732 req-d30f3775-80a9-4e70-808f-be3d22e32d4e tempest-ServerActionsTestOtherA-832026328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-357095d2-a379-4ab1-8b38-5a32a2c1839f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b15f5606-b951-42b7-acf5-db921812a295', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:36:33 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-01dfbaa4-6c1b-44fa-8c30-064593c2071e req-72ec3160-f5b2-4d42-b5bc-5dd8191ef07b tempest-TaggedAttachmentsTest-2125258503 None] attachment_update completed successfully. Sep 23 12:36:33 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-b92f5cd9-0e62-43c5-8a0a-68f7626d9732 req-d30f3775-80a9-4e70-808f-be3d22e32d4e tempest-ServerActionsTestOtherA-832026328 None] attachment_update completed successfully. Sep 23 12:36:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] Acquiring lock "cinder-quobyte-83de53e1-4d5a-43f1-802c-3f6997888b92" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:36:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] Lock "cinder-quobyte-83de53e1-4d5a-43f1-802c-3f6997888b92" acquired by "delete_volume" :: waited 0.047s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:36:34 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[9780687c-9d3a-4c26-952f-1efdd0f3cf55]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:36:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83de53e1-4d5a-43f1-802c-3f6997888b92 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:34 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83de53e1-4d5a-43f1-802c-3f6997888b92 Sep 23 12:36:34 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:35 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83de53e1-4d5a-43f1-802c-3f6997888b92" returned: 0 in 0.634s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83de53e1-4d5a-43f1-802c-3f6997888b92 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:35 devstack sudo[90742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83de53e1-4d5a-43f1-802c-3f6997888b92 Sep 23 12:36:35 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:35 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83de53e1-4d5a-43f1-802c-3f6997888b92" returned: 0 in 0.611s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] Lock "cinder-quobyte-83de53e1-4d5a-43f1-802c-3f6997888b92" released by "delete_volume" :: held 1.409s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:36:36 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] Created reservations ['5b5c957b-23f0-4fe8-ae88-08be33251b80'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:36:36 devstack cinder-volume[86085]: WARNING cinder.quota [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-436578830 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-436578830, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:36:36 devstack cinder-volume[86085]: WARNING cinder.quota [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-436578830 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-436578830, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:36:36 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] Created reservations ['7e8bd408-200e-454a-b820-66c4a005b4f2', '94a23067-721d-467f-89cd-404a3b0667ae', '6413e068-c6fa-49e9-b4b5-eddc21545fc7', '521b6f6c-b30e-40cb-8d83-0e8ac3b94414'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:36:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:36:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:36:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:36:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:36:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:36:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:36 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:36:36 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:37 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.493s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:37 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:36:37 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ca694072-8a02-47b7-8329-16dc1a2344a7 tempest-GroupsV314Test-1963616199 None] Delete group completed successfully. Sep 23 12:36:37 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-b8d58554-1740-4588-9297-52281ddc1482 req-67218e04-7cd4-4156-bda3-454b52b0f643 tempest-TaggedAttachmentsTest-2125258503 None] Terminate volume connection completed successfully. Sep 23 12:36:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-b8d58554-1740-4588-9297-52281ddc1482 req-67218e04-7cd4-4156-bda3-454b52b0f643 tempest-TaggedAttachmentsTest-2125258503 None] Deleting attachment 145367ae-771b-46d6-a641-5599a7940129. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:36:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c1f3b4bc-9095-4981-9540-66e4eb292bc0 tempest-GroupsV314Test-1963616199 None] Acquiring lock "cinder-quobyte-7c0efe6f-8857-4b6c-a316-cebe0f21c15e" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:36:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c1f3b4bc-9095-4981-9540-66e4eb292bc0 tempest-GroupsV314Test-1963616199 None] Lock "cinder-quobyte-7c0efe6f-8857-4b6c-a316-cebe0f21c15e" acquired by "delete_volume" :: waited 0.042s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:36:38 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10a5b2f-bc6f-4619-8c4b-ecf03da8926c]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:36:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c1f3b4bc-9095-4981-9540-66e4eb292bc0 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:38 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e Sep 23 12:36:38 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:38 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c1f3b4bc-9095-4981-9540-66e4eb292bc0 tempest-GroupsV314Test-1963616199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e" returned: 0 in 0.796s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c1f3b4bc-9095-4981-9540-66e4eb292bc0 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:38 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e Sep 23 12:36:38 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:39 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c1f3b4bc-9095-4981-9540-66e4eb292bc0 tempest-GroupsV314Test-1963616199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7c0efe6f-8857-4b6c-a316-cebe0f21c15e" returned: 0 in 0.779s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:39 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c1f3b4bc-9095-4981-9540-66e4eb292bc0 tempest-GroupsV314Test-1963616199 None] Lock "cinder-quobyte-7c0efe6f-8857-4b6c-a316-cebe0f21c15e" released by "delete_volume" :: held 1.731s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:36:39 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-c1f3b4bc-9095-4981-9540-66e4eb292bc0 tempest-GroupsV314Test-1963616199 None] Created reservations ['8ac7e66d-5cad-4a7a-b728-b11e22d97e5a'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:36:39 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-c1f3b4bc-9095-4981-9540-66e4eb292bc0 tempest-GroupsV314Test-1963616199 None] Created reservations ['e566b0a6-8a58-4eab-aaf7-e801b4bbcf11', '1c5a18cd-c073-4d29-a465-ec5ff5e9e564', 'e4421ed1-73fa-4f03-ae0b-d57ecead418f', 'd7e96289-6500-4b95-9cf1-d47551c2fb6f'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:36:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c1f3b4bc-9095-4981-9540-66e4eb292bc0 tempest-GroupsV314Test-1963616199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:36:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c1f3b4bc-9095-4981-9540-66e4eb292bc0 tempest-GroupsV314Test-1963616199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:36:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c1f3b4bc-9095-4981-9540-66e4eb292bc0 tempest-GroupsV314Test-1963616199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:36:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c1f3b4bc-9095-4981-9540-66e4eb292bc0 tempest-GroupsV314Test-1963616199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:36:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c1f3b4bc-9095-4981-9540-66e4eb292bc0 tempest-GroupsV314Test-1963616199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:36:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c1f3b4bc-9095-4981-9540-66e4eb292bc0 tempest-GroupsV314Test-1963616199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:40 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:36:40 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:40 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c1f3b4bc-9095-4981-9540-66e4eb292bc0 tempest-GroupsV314Test-1963616199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.707s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:40 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-c1f3b4bc-9095-4981-9540-66e4eb292bc0 tempest-GroupsV314Test-1963616199 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:36:40 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-c1f3b4bc-9095-4981-9540-66e4eb292bc0 tempest-GroupsV314Test-1963616199 None] Delete group completed successfully. Sep 23 12:36:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:36:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:36:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:36:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:36:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:36:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:36:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:41 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:36:41 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:42 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.930s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:42 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:36:42 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:36:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:36:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:36:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] Acquiring lock "cinder-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:36:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] Lock "cinder-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:36:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] Acquiring lock "cinder-quobyte-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:36:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] Lock "cinder-quobyte-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35" acquired by "delete_volume" :: waited 0.026s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:36:44 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78774fb-dd9c-4051-992b-a2868de76086]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:36:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:44 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35 Sep 23 12:36:44 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:44 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35" returned: 0 in 0.772s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:45 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35 Sep 23 12:36:45 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:45 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35" returned: 0 in 0.581s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] Lock "cinder-quobyte-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35" released by "delete_volume" :: held 1.453s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:36:45 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] Created reservations ['21ea20e7-415f-42ee-bf0f-98fac96c1bf2', 'c69809ff-340b-4688-9062-dd0695497552', 'd2806a58-d5e1-4ee8-820c-b618f33e9227', 'dd5e44ad-a6a7-4a52-a284-8b67d688fdc9'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:36:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:36:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:36:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:36:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:36:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:36:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:46 devstack sudo[90839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:36:46 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:46 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.597s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:46 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:36:46 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] Deleted volume successfully. Sep 23 12:36:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a6162bda-734d-40b5-a7f6-f0509a826c5a tempest-AttachVolumeShelveTestJSON-1645559046 None] Lock "cinder-b7a8a98c-7bb3-4d6e-8e2d-ccb8d0280e35-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:36:54 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-06bfe2f7-b728-4271-b59b-243723f31315 req-241273a3-1cb5-40ec-aacf-5eae29394538 tempest-ServerActionsTestOtherA-832026328 None] Terminate volume connection completed successfully. Sep 23 12:36:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-06bfe2f7-b728-4271-b59b-243723f31315 req-241273a3-1cb5-40ec-aacf-5eae29394538 tempest-ServerActionsTestOtherA-832026328 None] Deleting attachment b15f5606-b951-42b7-acf5-db921812a295. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:36:55 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] Acquiring lock "cinder-077a7ab7-f650-4130-9a9b-408be55b404d-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:36:55 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] Lock "cinder-077a7ab7-f650-4130-9a9b-408be55b404d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:36:55 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] Acquiring lock "cinder-quobyte-077a7ab7-f650-4130-9a9b-408be55b404d" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:36:55 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] Lock "cinder-quobyte-077a7ab7-f650-4130-9a9b-408be55b404d" acquired by "delete_volume" :: waited 0.043s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:36:55 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ca953e-4fd1-47c2-bf90-8d1b353a4d1d]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:36:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-077a7ab7-f650-4130-9a9b-408be55b404d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:55 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-077a7ab7-f650-4130-9a9b-408be55b404d Sep 23 12:36:55 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:56 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-077a7ab7-f650-4130-9a9b-408be55b404d" returned: 0 in 0.534s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-077a7ab7-f650-4130-9a9b-408be55b404d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:56 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-077a7ab7-f650-4130-9a9b-408be55b404d Sep 23 12:36:56 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:56 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-077a7ab7-f650-4130-9a9b-408be55b404d" returned: 0 in 0.466s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] Lock "cinder-quobyte-077a7ab7-f650-4130-9a9b-408be55b404d" released by "delete_volume" :: held 1.090s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:36:56 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] Created reservations ['0d7317f1-be69-47a4-87be-af92cfd6e4c6', '5b312f23-db62-4c2f-b779-70a36f942a50', 'f9703712-f9e4-423c-9bfb-155ee2390bc5', '5127e7da-b055-4f2c-a2e2-d8cfb882fffb'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:36:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:36:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:36:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:36:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:36:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:36:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:36:56 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:36:56 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:36:57 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Sep 23 12:36:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.291s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:36:57 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:36:57 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] Deleted volume successfully. Sep 23 12:36:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-12c560e2-f85a-4167-a727-a237f06ea7a5 tempest-TaggedAttachmentsTest-2125258503 None] Lock "cinder-077a7ab7-f650-4130-9a9b-408be55b404d-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:36:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-06bfe2f7-b728-4271-b59b-243723f31315 req-f1c88990-c50c-4a91-aa08-49234ecd0175 tempest-ServerActionsTestOtherA-832026328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:36:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-06bfe2f7-b728-4271-b59b-243723f31315 req-f1c88990-c50c-4a91-aa08-49234ecd0175 tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:36:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-06bfe2f7-b728-4271-b59b-243723f31315 req-f1c88990-c50c-4a91-aa08-49234ecd0175 tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:36:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-06bfe2f7-b728-4271-b59b-243723f31315 req-f1c88990-c50c-4a91-aa08-49234ecd0175 tempest-ServerActionsTestOtherA-832026328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-357095d2-a379-4ab1-8b38-5a32a2c1839f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2fe439a-6200-4ef1-9690-ccab01bd7595', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:36:57 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-06bfe2f7-b728-4271-b59b-243723f31315 req-f1c88990-c50c-4a91-aa08-49234ecd0175 tempest-ServerActionsTestOtherA-832026328 None] attachment_update completed successfully. Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Flow 'volume_create_manager' (f6b95fe2-0bfd-4cb5-998a-a2edbda48241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2e2bfe-0ac6-4b93-9f91-11868027dc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2e2bfe-0ac6-4b93-9f91-11868027dc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-428541526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e191ee76-4e8e-4da9-b813-af5ad52aef70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137197cdff8a4d83b7d050f6e2de198c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:37:01Z,use_quota=True,user_id='08f79a8b3bfe4fa68d8a3285f34fcf6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c65dcd-e93f-4e9a-9428-04120d7b3e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c65dcd-e93f-4e9a-9428-04120d7b3e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51dca636-96d8-4b7e-8a6a-b8603765cbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51dca636-96d8-4b7e-8a6a-b8603765cbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e191ee76-4e8e-4da9-b813-af5ad52aef70', 'volume_name': 'volume-e191ee76-4e8e-4da9-b813-af5ad52aef70', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69698c5c-f929-4c1d-8084-decec8a3b7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69698c5c-f929-4c1d-8084-decec8a3b7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1930c9a7-c9d6-406f-adbb-38845a03d0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:01 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Volume e191ee76-4e8e-4da9-b813-af5ad52aef70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e191ee76-4e8e-4da9-b813-af5ad52aef70', 'volume_size': 1} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-428541526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e191ee76-4e8e-4da9-b813-af5ad52aef70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137197cdff8a4d83b7d050f6e2de198c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:37:01Z,use_quota=True,user_id='08f79a8b3bfe4fa68d8a3285f34fcf6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Creating volume e191ee76-4e8e-4da9-b813-af5ad52aef70 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:37:01 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:37:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:01 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70 1073741824 Sep 23 12:37:01 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:02 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70 1073741824" returned: 0 in 0.871s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:02 devstack sudo[91409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70 Sep 23 12:37:02 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:03 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70" returned: 0 in 0.391s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:37:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1930c9a7-c9d6-406f-adbb-38845a03d0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e191ee76-4e8e-4da9-b813-af5ad52aef70', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa11739f-5599-4d95-b853-5ffa763a09f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:03 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Volume volume-e191ee76-4e8e-4da9-b813-af5ad52aef70 (e191ee76-4e8e-4da9-b813-af5ad52aef70): created successfully Sep 23 12:37:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa11739f-5599-4d95-b853-5ffa763a09f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Flow 'volume_create_manager' (f6b95fe2-0bfd-4cb5-998a-a2edbda48241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:37:03 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-0903e682-6f31-4d47-9860-c68d4ebf57ed req-4d43fac1-49bf-4399-81c7-139ec3bc372a tempest-VolumesSnapshotsTestJSON-1393213891 None] Created volume successfully. Sep 23 12:37:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-442b8742-740e-4066-affb-6e9e8cbda3b5 req-9b4478e1-d500-42ff-9844-d474286c8683 tempest-VolumesSnapshotsTestJSON-1393213891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-442b8742-740e-4066-affb-6e9e8cbda3b5 req-9b4478e1-d500-42ff-9844-d474286c8683 tempest-VolumesSnapshotsTestJSON-1393213891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [req-442b8742-740e-4066-affb-6e9e8cbda3b5 req-9b4478e1-d500-42ff-9844-d474286c8683 tempest-VolumesSnapshotsTestJSON-1393213891 None] Creating offline snapshot caf68ca0-02e2-400f-988b-95733d70d0ea of volume e191ee76-4e8e-4da9-b813-af5ad52aef70 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:37:04 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c574f4-b55d-45fd-89db-1ecb456eb46a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:37:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-442b8742-740e-4066-affb-6e9e8cbda3b5 req-9b4478e1-d500-42ff-9844-d474286c8683 tempest-VolumesSnapshotsTestJSON-1393213891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:04 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70 Sep 23 12:37:04 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:05 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-442b8742-740e-4066-affb-6e9e8cbda3b5 req-9b4478e1-d500-42ff-9844-d474286c8683 tempest-VolumesSnapshotsTestJSON-1393213891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70" returned: 0 in 1.111s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-442b8742-740e-4066-affb-6e9e8cbda3b5 req-9b4478e1-d500-42ff-9844-d474286c8683 tempest-VolumesSnapshotsTestJSON-1393213891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:05 devstack sudo[91417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea 1G Sep 23 12:37:05 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:06 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-442b8742-740e-4066-affb-6e9e8cbda3b5 req-9b4478e1-d500-42ff-9844-d474286c8683 tempest-VolumesSnapshotsTestJSON-1393213891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea 1G" returned: 0 in 0.834s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-442b8742-740e-4066-affb-6e9e8cbda3b5 req-9b4478e1-d500-42ff-9844-d474286c8683 tempest-VolumesSnapshotsTestJSON-1393213891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e191ee76-4e8e-4da9-b813-af5ad52aef70 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:06 devstack sudo[91422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e191ee76-4e8e-4da9-b813-af5ad52aef70 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea Sep 23 12:37:06 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:06 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-442b8742-740e-4066-affb-6e9e8cbda3b5 req-9b4478e1-d500-42ff-9844-d474286c8683 tempest-VolumesSnapshotsTestJSON-1393213891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e191ee76-4e8e-4da9-b813-af5ad52aef70 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea" returned: 0 in 0.573s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:06 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [req-442b8742-740e-4066-affb-6e9e8cbda3b5 req-9b4478e1-d500-42ff-9844-d474286c8683 tempest-VolumesSnapshotsTestJSON-1393213891 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea is being set with open permissions: ugo+rw Sep 23 12:37:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-442b8742-740e-4066-affb-6e9e8cbda3b5 req-9b4478e1-d500-42ff-9844-d474286c8683 tempest-VolumesSnapshotsTestJSON-1393213891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:06 devstack sudo[91427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea Sep 23 12:37:06 devstack sudo[91427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:07 devstack sudo[91427]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-442b8742-740e-4066-affb-6e9e8cbda3b5 req-9b4478e1-d500-42ff-9844-d474286c8683 tempest-VolumesSnapshotsTestJSON-1393213891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea" returned: 0 in 0.416s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-442b8742-740e-4066-affb-6e9e8cbda3b5 req-9b4478e1-d500-42ff-9844-d474286c8683 tempest-VolumesSnapshotsTestJSON-1393213891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:07 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.info Sep 23 12:37:07 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:07 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-442b8742-740e-4066-affb-6e9e8cbda3b5 req-9b4478e1-d500-42ff-9844-d474286c8683 tempest-VolumesSnapshotsTestJSON-1393213891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.info" returned: 0 in 0.437s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:07 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [req-442b8742-740e-4066-affb-6e9e8cbda3b5 req-9b4478e1-d500-42ff-9844-d474286c8683 tempest-VolumesSnapshotsTestJSON-1393213891 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.info is being set with open permissions: ugo+rw Sep 23 12:37:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-442b8742-740e-4066-affb-6e9e8cbda3b5 req-9b4478e1-d500-42ff-9844-d474286c8683 tempest-VolumesSnapshotsTestJSON-1393213891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:07 devstack sudo[91434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.info Sep 23 12:37:07 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:08 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-442b8742-740e-4066-affb-6e9e8cbda3b5 req-9b4478e1-d500-42ff-9844-d474286c8683 tempest-VolumesSnapshotsTestJSON-1393213891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.info" returned: 0 in 0.338s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-442b8742-740e-4066-affb-6e9e8cbda3b5 req-9b4478e1-d500-42ff-9844-d474286c8683 tempest-VolumesSnapshotsTestJSON-1393213891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.881s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:08 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=69,cinder:UPDATE=52,cinder:INSERT=20,cinder:DELETE=2 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:37:08 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=79,cinder:UPDATE=66,cinder:INSERT=17,cinder:DELETE=3 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:37:08 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-442b8742-740e-4066-affb-6e9e8cbda3b5 req-9b4478e1-d500-42ff-9844-d474286c8683 tempest-VolumesSnapshotsTestJSON-1393213891 None] Create snapshot completed successfully Sep 23 12:37:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] Acquiring lock "cinder-caf68ca0-02e2-400f-988b-95733d70d0ea-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] Lock "cinder-caf68ca0-02e2-400f-988b-95733d70d0ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] Acquiring lock "cinder-quobyte-e191ee76-4e8e-4da9-b813-af5ad52aef70" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] Lock "cinder-quobyte-e191ee76-4e8e-4da9-b813-af5ad52aef70" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] Acquiring lock "cinder-quobyte-caf68ca0-02e2-400f-988b-95733d70d0ea" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] Lock "cinder-quobyte-caf68ca0-02e2-400f-988b-95733d70d0ea" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:09 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] Deleting offline snapshot caf68ca0-02e2-400f-988b-95733d70d0ea of volume e191ee76-4e8e-4da9-b813-af5ad52aef70 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:37:09 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] snapshot_file for this snap is: volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:37:09 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f5f7e9-fa2d-47f7-8d88-a939bd78e719]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:37:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:09 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea Sep 23 12:37:09 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:09 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea" returned: 0 in 0.473s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:09 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e191ee76-4e8e-4da9-b813-af5ad52aef70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:37:09 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77f2032-66e7-40a1-a6a9-685819cd26c0]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:37:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:09 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70 Sep 23 12:37:09 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:10 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70" returned: 0 in 0.448s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:10 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea Sep 23 12:37:10 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:10 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea" returned: 0 in 0.554s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:10 devstack sudo[91455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea Sep 23 12:37:10 devstack sudo[91455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:11 devstack sudo[91455]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70.caf68ca0-02e2-400f-988b-95733d70d0ea" returned: 0 in 0.259s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] Lock "cinder-quobyte-caf68ca0-02e2-400f-988b-95733d70d0ea" released by "_delete_snapshot" :: held 1.902s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:37:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] Lock "cinder-quobyte-e191ee76-4e8e-4da9-b813-af5ad52aef70" released by "delete_snapshot" :: held 1.943s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:37:11 devstack cinder-volume[86085]: WARNING cinder.quota [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:37:11 devstack cinder-volume[86085]: DEBUG cinder.quota [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] Created reservations ['be6c153b-0f50-4cbf-9632-82672177b96d', '1fd0194b-fcb2-45f6-92d5-29f7f3b05f4b', '4aa3e1b1-bddf-4a70-8a0c-26697ace9b75', '996b2248-2c1d-4889-b9c2-d49e9f18fad4'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:37:11 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] Delete snapshot completed successfully. Sep 23 12:37:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-cbc1a2a8-8584-4f53-b5ca-7d642d4d9e4c req-ed6f4cfd-f9cd-45fe-aa50-adaaaf9f6063 tempest-VolumesSnapshotsTestJSON-1393213891 None] Lock "cinder-caf68ca0-02e2-400f-988b-95733d70d0ea-delete_snapshot" released by "delete_snapshot" :: held 2.130s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:37:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] Acquiring lock "cinder-e191ee76-4e8e-4da9-b813-af5ad52aef70-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] Lock "cinder-e191ee76-4e8e-4da9-b813-af5ad52aef70-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] Acquiring lock "cinder-quobyte-e191ee76-4e8e-4da9-b813-af5ad52aef70" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] Lock "cinder-quobyte-e191ee76-4e8e-4da9-b813-af5ad52aef70" acquired by "delete_volume" :: waited 0.047s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:11 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d04c515-66b1-4d99-a18b-044367c3a453]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:37:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:12 devstack sudo[91459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70 Sep 23 12:37:12 devstack sudo[91459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:12 devstack sudo[91459]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70" returned: 0 in 0.446s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:12 devstack sudo[91464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70 Sep 23 12:37:12 devstack sudo[91464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:12 devstack sudo[91464]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e191ee76-4e8e-4da9-b813-af5ad52aef70" returned: 0 in 0.401s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] Lock "cinder-quobyte-e191ee76-4e8e-4da9-b813-af5ad52aef70" released by "delete_volume" :: held 0.991s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:37:12 devstack cinder-volume[86085]: DEBUG cinder.quota [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] Created reservations ['4e023a65-b19f-4350-b6c8-e89f6b93dadb', 'e57f0af5-9a8d-43b3-9017-d9a8b067d3c4', '459a1ddb-f121-40bb-8fc8-bab6aebbda33', '0796affa-a452-4087-9b25-51d59c461d4b'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:37:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:37:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:37:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:13 devstack sudo[91468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:37:13 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:13 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.431s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:13 devstack cinder-volume[86085]: DEBUG cinder.manager [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:37:13 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] Deleted volume successfully. Sep 23 12:37:13 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-a8def17a-84b3-4b3b-8aa0-d08850eda403 req-2f6879e1-3b86-4e9a-856b-b64a33d1a104 tempest-VolumesSnapshotsTestJSON-1393213891 None] Lock "cinder-e191ee76-4e8e-4da9-b813-af5ad52aef70-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Flow 'volume_create_manager' (9d6e95f8-f6b3-44b3-bdb8-ecb643ee8f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8676cb47-c562-4464-839a-e6ef337d28a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8676cb47-c562-4464-839a-e6ef337d28a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-39201405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0595ee93-e420-403e-a699-4a33c899c943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60c38dddeaa241559dd2943a0deab5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:37:19Z,use_quota=True,user_id='79ebb6f97f5e4dabb14d2f64c6ca2bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f94b04-863c-459b-889f-621f33d5b927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f94b04-863c-459b-889f-621f33d5b927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d86822b-4a9f-4f72-b418-29b8e4295260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d86822b-4a9f-4f72-b418-29b8e4295260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0595ee93-e420-403e-a699-4a33c899c943', 'volume_name': 'volume-0595ee93-e420-403e-a699-4a33c899c943', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ad1262-61e0-49a4-be0a-a78d773006f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ad1262-61e0-49a4-be0a-a78d773006f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c91aa0b-8952-44a3-a99f-3d7413238cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:19 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Volume 0595ee93-e420-403e-a699-4a33c899c943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0595ee93-e420-403e-a699-4a33c899c943', 'volume_size': 1} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-39201405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0595ee93-e420-403e-a699-4a33c899c943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60c38dddeaa241559dd2943a0deab5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:37:19Z,use_quota=True,user_id='79ebb6f97f5e4dabb14d2f64c6ca2bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Creating volume 0595ee93-e420-403e-a699-4a33c899c943 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:37:19 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0595ee93-e420-403e-a699-4a33c899c943 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:19 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0595ee93-e420-403e-a699-4a33c899c943 1073741824 Sep 23 12:37:19 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Flow 'volume_create_manager' (f3222eef-bcc8-4d55-a74d-4580ab0fe660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71125568-dc12-4412-b8be-8c0cba9a0b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71125568-dc12-4412-b8be-8c0cba9a0b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-453285092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcb34ed-148b-4666-bc5f-5c2297c2c467,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9d27dd687034057bff28be598946613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:37:20Z,use_quota=True,user_id='464df6560dbc4e5d9dac9e17c38023bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647a3eb6-7180-4cae-838b-2e57ff7c4fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647a3eb6-7180-4cae-838b-2e57ff7c4fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb2c122-c49a-4e2c-9807-fa9364e23299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb2c122-c49a-4e2c-9807-fa9364e23299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fcb34ed-148b-4666-bc5f-5c2297c2c467', 'volume_name': 'volume-5fcb34ed-148b-4666-bc5f-5c2297c2c467', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f095f4-661d-4754-8876-08777e42429c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:19 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f095f4-661d-4754-8876-08777e42429c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29794f09-b6d0-43e9-be4e-709f659ca20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:19 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Volume 5fcb34ed-148b-4666-bc5f-5c2297c2c467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fcb34ed-148b-4666-bc5f-5c2297c2c467', 'volume_size': 1} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0595ee93-e420-403e-a699-4a33c899c943 1073741824" returned: 0 in 0.560s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0595ee93-e420-403e-a699-4a33c899c943 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:19 devstack sudo[91521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0595ee93-e420-403e-a699-4a33c899c943 Sep 23 12:37:19 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:20 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0595ee93-e420-403e-a699-4a33c899c943" returned: 0 in 0.274s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:20 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:37:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.319s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:20 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-453285092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcb34ed-148b-4666-bc5f-5c2297c2c467,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9d27dd687034057bff28be598946613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:37:20Z,use_quota=True,user_id='464df6560dbc4e5d9dac9e17c38023bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:37:20 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Creating volume 5fcb34ed-148b-4666-bc5f-5c2297c2c467 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:37:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:20 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:37:20 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:37:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:20 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:37:20 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:37:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5fcb34ed-148b-4666-bc5f-5c2297c2c467 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:20 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c91aa0b-8952-44a3-a99f-3d7413238cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0595ee93-e420-403e-a699-4a33c899c943', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:20 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856cbef5-2c21-463a-b263-1b1095b3780c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:20 devstack sudo[91524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5fcb34ed-148b-4666-bc5f-5c2297c2c467 1073741824 Sep 23 12:37:20 devstack sudo[91524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:20 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Volume volume-0595ee93-e420-403e-a699-4a33c899c943 (0595ee93-e420-403e-a699-4a33c899c943): created successfully Sep 23 12:37:20 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856cbef5-2c21-463a-b263-1b1095b3780c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:20 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Flow 'volume_create_manager' (9d6e95f8-f6b3-44b3-bdb8-ecb643ee8f95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:37:20 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-1cecaea6-9b87-4415-ba16-6fa2effdcfc6 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Created volume successfully. Sep 23 12:37:20 devstack sudo[91524]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5fcb34ed-148b-4666-bc5f-5c2297c2c467 1073741824" returned: 0 in 0.545s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5fcb34ed-148b-4666-bc5f-5c2297c2c467 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:20 devstack sudo[91530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5fcb34ed-148b-4666-bc5f-5c2297c2c467 Sep 23 12:37:20 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:21 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5fcb34ed-148b-4666-bc5f-5c2297c2c467" returned: 0 in 0.253s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:37:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29794f09-b6d0-43e9-be4e-709f659ca20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fcb34ed-148b-4666-bc5f-5c2297c2c467', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320f76ca-e534-4912-bdcb-ead01d372c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:21 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Volume volume-5fcb34ed-148b-4666-bc5f-5c2297c2c467 (5fcb34ed-148b-4666-bc5f-5c2297c2c467): created successfully Sep 23 12:37:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320f76ca-e534-4912-bdcb-ead01d372c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Flow 'volume_create_manager' (f3222eef-bcc8-4d55-a74d-4580ab0fe660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:37:21 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0b2af8a0-da2a-4b6e-b82b-756b14206d30 tempest-VolumesTestJSON-474498941 None] Created volume successfully. Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Acquiring lock "cinder-0595ee93-e420-403e-a699-4a33c899c943-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Lock "cinder-0595ee93-e420-403e-a699-4a33c899c943-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Acquiring lock "cinder-quobyte-0595ee93-e420-403e-a699-4a33c899c943" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Lock "cinder-quobyte-0595ee93-e420-403e-a699-4a33c899c943" acquired by "delete_volume" :: waited 0.026s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cea65e-479c-4be5-94a1-bc539282a3a3]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0595ee93-e420-403e-a699-4a33c899c943 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Flow 'volume_create_manager' (d5e7b76b-edb0-4359-8634-720acc0821ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30de51b4-aa52-4d53-967e-ab0047ddbb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30de51b4-aa52-4d53-967e-ab0047ddbb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-647131367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40e8d6e-c604-4a54-a7a6-def00b401f0a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9d27dd687034057bff28be598946613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:37:23Z,use_quota=True,user_id='464df6560dbc4e5d9dac9e17c38023bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b675ac91-4c8e-4301-ac48-ddd7ebdbd309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b675ac91-4c8e-4301-ac48-ddd7ebdbd309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c0d899-6979-4f45-a68a-45f1107a74b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c0d899-6979-4f45-a68a-45f1107a74b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c40e8d6e-c604-4a54-a7a6-def00b401f0a', 'volume_name': 'volume-c40e8d6e-c604-4a54-a7a6-def00b401f0a', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517dbf2a-4301-4b17-88f3-28d48e975c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517dbf2a-4301-4b17-88f3-28d48e975c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddd6b59-9eb0-4da8-adda-da27de8c705d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:22 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Volume c40e8d6e-c604-4a54-a7a6-def00b401f0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c40e8d6e-c604-4a54-a7a6-def00b401f0a', 'volume_size': 1} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:22 devstack sudo[91534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0595ee93-e420-403e-a699-4a33c899c943 Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-647131367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40e8d6e-c604-4a54-a7a6-def00b401f0a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9d27dd687034057bff28be598946613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:37:23Z,use_quota=True,user_id='464df6560dbc4e5d9dac9e17c38023bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Creating volume c40e8d6e-c604-4a54-a7a6-def00b401f0a {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:37:22 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:37:22 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:37:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c40e8d6e-c604-4a54-a7a6-def00b401f0a 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:22 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c40e8d6e-c604-4a54-a7a6-def00b401f0a 1073741824 Sep 23 12:37:22 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:23 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0595ee93-e420-403e-a699-4a33c899c943" returned: 0 in 0.541s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0595ee93-e420-403e-a699-4a33c899c943 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:23 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0595ee93-e420-403e-a699-4a33c899c943 Sep 23 12:37:23 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:23 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c40e8d6e-c604-4a54-a7a6-def00b401f0a 1073741824" returned: 0 in 0.593s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:23 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c40e8d6e-c604-4a54-a7a6-def00b401f0a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0595ee93-e420-403e-a699-4a33c899c943" returned: 0 in 0.343s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:23 devstack sudo[91548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c40e8d6e-c604-4a54-a7a6-def00b401f0a Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Lock "cinder-quobyte-0595ee93-e420-403e-a699-4a33c899c943" released by "delete_volume" :: held 0.987s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:37:23 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Created reservations ['a740a652-5b95-45e9-99f1-2a316704134f', '94a4fde3-9aec-4676-8051-68fddcf5be9e', 'c4d066b9-15e7-4184-9e42-3810984b95e0', '35d0d05d-ab42-498f-a695-09268380bf61'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:23 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:37:23 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:23 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c40e8d6e-c604-4a54-a7a6-def00b401f0a" returned: 0 in 0.327s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddd6b59-9eb0-4da8-adda-da27de8c705d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c40e8d6e-c604-4a54-a7a6-def00b401f0a', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2816807b-e237-48a6-bba6-25244232ddd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:23 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Volume volume-c40e8d6e-c604-4a54-a7a6-def00b401f0a (c40e8d6e-c604-4a54-a7a6-def00b401f0a): created successfully Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2816807b-e237-48a6-bba6-25244232ddd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Flow 'volume_create_manager' (d5e7b76b-edb0-4359-8634-720acc0821ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:37:23 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d1997ea5-a0a1-4532-abe0-9b1bdfcb5272 tempest-VolumesTestJSON-474498941 None] Created volume successfully. Sep 23 12:37:23 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.280s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:24 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:37:24 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Deleted volume successfully. Sep 23 12:37:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e849e4ec-5b54-4b22-8f0d-650ef63a6429 tempest-VolumeQuotasNegativeTestJSON-139580148 None] Lock "cinder-0595ee93-e420-403e-a699-4a33c899c943-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Flow 'volume_create_manager' (ab98e71d-9425-4787-ba71-49e7afa8bf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47eda0d1-da8e-4b98-bfab-0a2ca7e12498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47eda0d1-da8e-4b98-bfab-0a2ca7e12498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1237953302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47fd268-c123-420e-a570-0027ca406cfb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9d27dd687034057bff28be598946613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:37:26Z,use_quota=True,user_id='464df6560dbc4e5d9dac9e17c38023bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb004e6-a099-4086-9d2c-12674fad18bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb004e6-a099-4086-9d2c-12674fad18bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a51559-7f16-4df9-89fd-5ffa94e6263e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a51559-7f16-4df9-89fd-5ffa94e6263e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f47fd268-c123-420e-a570-0027ca406cfb', 'volume_name': 'volume-f47fd268-c123-420e-a570-0027ca406cfb', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401c23ac-b525-437b-a949-26d2d46cdd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401c23ac-b525-437b-a949-26d2d46cdd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93603e99-d2bb-4792-83de-fc2df82ecc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:25 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Volume f47fd268-c123-420e-a570-0027ca406cfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f47fd268-c123-420e-a570-0027ca406cfb', 'volume_size': 1} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1237953302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47fd268-c123-420e-a570-0027ca406cfb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9d27dd687034057bff28be598946613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:37:26Z,use_quota=True,user_id='464df6560dbc4e5d9dac9e17c38023bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Creating volume f47fd268-c123-420e-a570-0027ca406cfb {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:37:25 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:37:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f47fd268-c123-420e-a570-0027ca406cfb 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:26 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f47fd268-c123-420e-a570-0027ca406cfb 1073741824 Sep 23 12:37:26 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:26 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f47fd268-c123-420e-a570-0027ca406cfb 1073741824" returned: 0 in 0.895s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f47fd268-c123-420e-a570-0027ca406cfb {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:26 devstack sudo[91608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f47fd268-c123-420e-a570-0027ca406cfb Sep 23 12:37:26 devstack sudo[91608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:27 devstack sudo[91608]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f47fd268-c123-420e-a570-0027ca406cfb" returned: 0 in 0.335s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:37:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93603e99-d2bb-4792-83de-fc2df82ecc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f47fd268-c123-420e-a570-0027ca406cfb', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e119d5e0-b800-441d-b2a8-a506a563c25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:27 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Volume volume-f47fd268-c123-420e-a570-0027ca406cfb (f47fd268-c123-420e-a570-0027ca406cfb): created successfully Sep 23 12:37:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e119d5e0-b800-441d-b2a8-a506a563c25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Flow 'volume_create_manager' (ab98e71d-9425-4787-ba71-49e7afa8bf6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:37:27 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-e6203f14-38b8-4607-a0f9-0450152a7c11 tempest-VolumesTestJSON-474498941 None] Created volume successfully. Sep 23 12:37:28 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] Acquiring lock "cinder-f47fd268-c123-420e-a570-0027ca406cfb-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:29 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] Lock "cinder-f47fd268-c123-420e-a570-0027ca406cfb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:29 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] Acquiring lock "cinder-quobyte-f47fd268-c123-420e-a570-0027ca406cfb" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:29 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] Lock "cinder-quobyte-f47fd268-c123-420e-a570-0027ca406cfb" acquired by "delete_volume" :: waited 0.034s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:29 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e970048-09c0-4b7a-8cce-88ef36e4dd1b]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:37:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f47fd268-c123-420e-a570-0027ca406cfb {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:29 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f47fd268-c123-420e-a570-0027ca406cfb Sep 23 12:37:29 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:29 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f47fd268-c123-420e-a570-0027ca406cfb" returned: 0 in 0.645s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f47fd268-c123-420e-a570-0027ca406cfb {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:29 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f47fd268-c123-420e-a570-0027ca406cfb Sep 23 12:37:29 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:30 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f47fd268-c123-420e-a570-0027ca406cfb" returned: 0 in 0.422s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] Lock "cinder-quobyte-f47fd268-c123-420e-a570-0027ca406cfb" released by "delete_volume" :: held 1.150s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:37:30 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] Created reservations ['6f1a064f-3884-4e35-b185-9c25b20d3938', '2a6a8b22-2804-4d8e-9d17-803cb811663d', 'fd74afea-1810-4115-858e-407f3fcb15a8', 'a3df8ad0-06ab-483e-a72c-9b8f57ddbe48'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:37:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:30 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:37:30 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:37:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:30 devstack sudo[91646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:37:30 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:30 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.355s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:30 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:37:30 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] Deleted volume successfully. Sep 23 12:37:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fb17368a-8c99-48b1-a46a-2945899bb634 tempest-VolumesTestJSON-474498941 None] Lock "cinder-f47fd268-c123-420e-a570-0027ca406cfb-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:37:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] Acquiring lock "cinder-c40e8d6e-c604-4a54-a7a6-def00b401f0a-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] Lock "cinder-c40e8d6e-c604-4a54-a7a6-def00b401f0a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] Acquiring lock "cinder-quobyte-c40e8d6e-c604-4a54-a7a6-def00b401f0a" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] Lock "cinder-quobyte-c40e8d6e-c604-4a54-a7a6-def00b401f0a" acquired by "delete_volume" :: waited 0.034s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:31 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a14822-6638-4e42-8444-261d5361e38a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:37:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c40e8d6e-c604-4a54-a7a6-def00b401f0a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:31 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c40e8d6e-c604-4a54-a7a6-def00b401f0a Sep 23 12:37:31 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:32 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c40e8d6e-c604-4a54-a7a6-def00b401f0a" returned: 0 in 0.681s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c40e8d6e-c604-4a54-a7a6-def00b401f0a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:32 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-5e81b2dc-1938-47f0-b0bd-d885625be4d5 tempest-ServerActionsTestOtherA-832026328 None] Terminate volume connection completed successfully. Sep 23 12:37:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-5e81b2dc-1938-47f0-b0bd-d885625be4d5 tempest-ServerActionsTestOtherA-832026328 None] Deleting attachment a2fe439a-6200-4ef1-9690-ccab01bd7595. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:37:32 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c40e8d6e-c604-4a54-a7a6-def00b401f0a Sep 23 12:37:32 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] Acquiring lock "cinder-357095d2-a379-4ab1-8b38-5a32a2c1839f-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] Lock "cinder-357095d2-a379-4ab1-8b38-5a32a2c1839f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:32 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c40e8d6e-c604-4a54-a7a6-def00b401f0a" returned: 0 in 0.405s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] Acquiring lock "cinder-quobyte-357095d2-a379-4ab1-8b38-5a32a2c1839f" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] Lock "cinder-quobyte-c40e8d6e-c604-4a54-a7a6-def00b401f0a" released by "delete_volume" :: held 1.207s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:37:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] Lock "cinder-quobyte-357095d2-a379-4ab1-8b38-5a32a2c1839f" acquired by "delete_volume" :: waited 0.032s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:32 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc2580b-eb94-4cf2-9e2d-ce6ebbdf37f7]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:37:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-357095d2-a379-4ab1-8b38-5a32a2c1839f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:32 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] Created reservations ['4e8b6e4b-05a6-43fd-b559-09e33273bc4e', '4769cc1d-6f8e-4403-aa79-8805db242b01', '3a78f34b-7c01-4f57-86a5-9498d3c1d631', 'd9d48b4c-c084-4d92-ba12-2a48c89311e3'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:37:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:37:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:37:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:32 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:37:32 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:32 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-357095d2-a379-4ab1-8b38-5a32a2c1839f Sep 23 12:37:32 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:33 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.510s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:33 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:37:33 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] Deleted volume successfully. Sep 23 12:37:33 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-357095d2-a379-4ab1-8b38-5a32a2c1839f" returned: 0 in 0.679s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-357095d2-a379-4ab1-8b38-5a32a2c1839f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ab3af44d-e006-4bc0-a56c-a36c97b8a41f tempest-VolumesTestJSON-474498941 None] Lock "cinder-c40e8d6e-c604-4a54-a7a6-def00b401f0a-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:37:33 devstack sudo[91669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-357095d2-a379-4ab1-8b38-5a32a2c1839f Sep 23 12:37:33 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] Acquiring lock "cinder-5fcb34ed-148b-4666-bc5f-5c2297c2c467-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] Lock "cinder-5fcb34ed-148b-4666-bc5f-5c2297c2c467-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:33 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-357095d2-a379-4ab1-8b38-5a32a2c1839f" returned: 0 in 0.351s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] Lock "cinder-quobyte-357095d2-a379-4ab1-8b38-5a32a2c1839f" released by "delete_volume" :: held 1.111s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:37:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] Acquiring lock "cinder-quobyte-5fcb34ed-148b-4666-bc5f-5c2297c2c467" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] Lock "cinder-quobyte-5fcb34ed-148b-4666-bc5f-5c2297c2c467" acquired by "delete_volume" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:33 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f81746e-180b-42b8-bc9c-e9a392501d57]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:37:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5fcb34ed-148b-4666-bc5f-5c2297c2c467 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:33 devstack cinder-volume[86085]: DEBUG cinder.quota [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] Created reservations ['125e35cc-f26b-44f9-9191-d2bfa3313eff', 'd34f910e-e75d-4068-a8fc-2d7ad62ed677', '25b7443f-40f2-496b-87a6-f3f643020567', 'e3ca8bb5-9642-4967-a486-3a20ffc29a74'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:37:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:37:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:37:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:34 devstack sudo[91673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:37:34 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:34 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5fcb34ed-148b-4666-bc5f-5c2297c2c467 Sep 23 12:37:34 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:34 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.337s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:34 devstack cinder-volume[86085]: DEBUG cinder.manager [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:37:34 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] Deleted volume successfully. Sep 23 12:37:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-5fbda28a-31b8-4aef-bdbb-a700563853f3 req-14ab170f-e5f1-42a2-819d-edf8d9a8b3b8 tempest-ServerActionsTestOtherA-832026328 None] Lock "cinder-357095d2-a379-4ab1-8b38-5a32a2c1839f-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:37:34 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5fcb34ed-148b-4666-bc5f-5c2297c2c467" returned: 0 in 0.517s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5fcb34ed-148b-4666-bc5f-5c2297c2c467 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:34 devstack sudo[91680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5fcb34ed-148b-4666-bc5f-5c2297c2c467 Sep 23 12:37:34 devstack sudo[91680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] Acquiring lock "cinder-3505bb89-02c7-4fd4-b9fc-a9af14485017-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] Lock "cinder-3505bb89-02c7-4fd4-b9fc-a9af14485017-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:34 devstack sudo[91680]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5fcb34ed-148b-4666-bc5f-5c2297c2c467" returned: 0 in 0.412s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] Acquiring lock "cinder-quobyte-3505bb89-02c7-4fd4-b9fc-a9af14485017" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] Lock "cinder-quobyte-5fcb34ed-148b-4666-bc5f-5c2297c2c467" released by "delete_volume" :: held 0.995s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:37:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] Lock "cinder-quobyte-3505bb89-02c7-4fd4-b9fc-a9af14485017" acquired by "delete_volume" :: waited 0.028s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:34 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7011d1-f5a8-4c59-a045-e538aa40a148]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:37:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3505bb89-02c7-4fd4-b9fc-a9af14485017 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:34 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] Created reservations ['843c6914-fe77-4a2d-b39e-058bbf699348', '26598ce3-864a-4fff-b6d8-984bac1e3aed', 'cfa905a2-d507-49b7-a465-9806c6c3fc9c', '21a178c5-247c-4d77-b31d-7500134ebf93'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:35 devstack sudo[91686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3505bb89-02c7-4fd4-b9fc-a9af14485017 Sep 23 12:37:35 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:35 devstack sudo[91688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:37:35 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:35 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3505bb89-02c7-4fd4-b9fc-a9af14485017" returned: 0 in 0.506s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3505bb89-02c7-4fd4-b9fc-a9af14485017 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:35 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.379s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:37:35 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] Deleted volume successfully. Sep 23 12:37:35 devstack sudo[91696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3505bb89-02c7-4fd4-b9fc-a9af14485017 Sep 23 12:37:35 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1652d688-6771-4ed3-bd71-edd15d09b40c tempest-VolumesTestJSON-474498941 None] Lock "cinder-5fcb34ed-148b-4666-bc5f-5c2297c2c467-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:37:35 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3505bb89-02c7-4fd4-b9fc-a9af14485017" returned: 0 in 0.336s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] Lock "cinder-quobyte-3505bb89-02c7-4fd4-b9fc-a9af14485017" released by "delete_volume" :: held 0.920s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] Created reservations ['0f1de7a1-be47-4813-a310-c9dd598ce741', '650a60f3-0c1d-4e9f-9df5-218c944b4abc', 'b03b51c2-03a4-4afa-9499-2d00613c5257', 'de1f023a-cdd6-4c53-a598-9782d79ffd01'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:36 devstack sudo[91699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:37:36 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:36 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.354s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:36 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:37:36 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] Deleted volume successfully. Sep 23 12:37:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-778f0955-cecf-41da-baee-8b177eafd999 tempest-ServerActionsTestOtherA-832026328 None] Lock "cinder-3505bb89-02c7-4fd4-b9fc-a9af14485017-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:37:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:37:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:37:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:37:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:41 devstack sudo[91790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:37:41 devstack sudo[91790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:42 devstack sudo[91790]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.661s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:42 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:37:42 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:37:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:37:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:37:45 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f0fcd2fd-cedf-4274-9370-bb19d61eb8bc tempest-GroupSnapshotsTest-1165375712 None] Group tempest-GroupSnapshotsTest-Group-194374240: creating Sep 23 12:37:45 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f0fcd2fd-cedf-4274-9370-bb19d61eb8bc tempest-GroupSnapshotsTest-1165375712 None] Group tempest-GroupSnapshotsTest-Group-194374240: created successfully Sep 23 12:37:45 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f0fcd2fd-cedf-4274-9370-bb19d61eb8bc tempest-GroupSnapshotsTest-1165375712 None] Create group completed successfully. Sep 23 12:37:47 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:37:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Flow 'volume_create_manager' (e38e146b-9141-4372-8764-76b361ae937c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:37:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2565cc18-1c5f-4049-b5fb-e43511b94362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2565cc18-1c5f-4049-b5fb-e43511b94362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1071061610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58737418-4563-4182-92e8-ab6b932dd488,host='devstack@QuobyteHD#QuobyteHD',id=bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9168358ddb434985934015f1d67af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:37:48Z,use_quota=True,user_id='c16b8034c7414f49af59e7bbcf30c0aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddcf7bff-d546-464c-8544-738988a26b79),volume_type_id=ddcf7bff-d546-464c-8544-738988a26b79)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53a2571-e678-4c15-b22c-d9d145555588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53a2571-e678-4c15-b22c-d9d145555588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8305d2-d7f6-4715-aa58-ac8d359dc448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8305d2-d7f6-4715-aa58-ac8d359dc448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01', 'volume_name': 'volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653b05ca-3724-4c6d-a026-9283a893bc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653b05ca-3724-4c6d-a026-9283a893bc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b71decb-5130-41cf-b005-702065e7a6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:48 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Volume bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01', 'volume_size': 1} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=58737418-4563-4182-92e8-ab6b932dd488,created_at=2026-09-23T10:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1071061610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58737418-4563-4182-92e8-ab6b932dd488,host='devstack@QuobyteHD#QuobyteHD',id=bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9168358ddb434985934015f1d67af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:37:48Z,use_quota=True,user_id='c16b8034c7414f49af59e7bbcf30c0aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddcf7bff-d546-464c-8544-738988a26b79),volume_type_id=ddcf7bff-d546-464c-8544-738988a26b79)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Creating volume bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:37:48 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:48 devstack sudo[91848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 1073741824 Sep 23 12:37:48 devstack sudo[91848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Flow 'volume_create_manager' (49d415b5-b0de-4e4f-b9cc-329b24f953fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877dd3cf-f6ad-426a-88fe-8056a8a15676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877dd3cf-f6ad-426a-88fe-8056a8a15676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-289603839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a7f13ac-939f-465f-8f1f-843d499e33fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d31f197506f04e879a0db6c506e91a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:37:48Z,use_quota=True,user_id='8736c88aeafe4253bf9fc0b3518fbdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5843a389-230f-41d8-b7b3-80b252fdcb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5843a389-230f-41d8-b7b3-80b252fdcb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f49827-9e82-4b8c-97b8-01ad8645fa31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f49827-9e82-4b8c-97b8-01ad8645fa31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a7f13ac-939f-465f-8f1f-843d499e33fc', 'volume_name': 'volume-4a7f13ac-939f-465f-8f1f-843d499e33fc', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2af4ed-4e5d-4799-a0f1-771792a70fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2af4ed-4e5d-4799-a0f1-771792a70fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3135b580-9c5e-4709-b72f-479d210be7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:48 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Volume 4a7f13ac-939f-465f-8f1f-843d499e33fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a7f13ac-939f-465f-8f1f-843d499e33fc', 'volume_size': 1} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:48 devstack sudo[91848]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 1073741824" returned: 0 in 0.906s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:49 devstack sudo[91860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 Sep 23 12:37:49 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:49 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01" returned: 0 in 0.296s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:37:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.898s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-289603839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a7f13ac-939f-465f-8f1f-843d499e33fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d31f197506f04e879a0db6c506e91a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:37:48Z,use_quota=True,user_id='8736c88aeafe4253bf9fc0b3518fbdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:37:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Creating volume 4a7f13ac-939f-465f-8f1f-843d499e33fc {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:37:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:37:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:37:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:37:49 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:37:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b71decb-5130-41cf-b005-702065e7a6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:49 devstack sudo[91864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc 1073741824 Sep 23 12:37:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1230ffcf-eae1-4616-bd0a-91008397d63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:49 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:49 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Volume volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 (bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01): created successfully Sep 23 12:37:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1230ffcf-eae1-4616-bd0a-91008397d63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Flow 'volume_create_manager' (e38e146b-9141-4372-8764-76b361ae937c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:37:49 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-16ba7bbf-9d84-4d6d-bf2a-36d868682722 tempest-GroupSnapshotsTest-1165375712 None] Created volume successfully. Sep 23 12:37:50 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc 1073741824" returned: 0 in 0.734s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:50 devstack sudo[91870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc Sep 23 12:37:50 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:50 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] GroupSnapshot c2581221-a899-48d2-bd2a-15f3d77dd095: creating. Sep 23 12:37:50 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc" returned: 0 in 0.550s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:37:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] Group snapshot c2581221-a899-48d2-bd2a-15f3d77dd095: creating. {{(pid=86085) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 12:37:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3135b580-9c5e-4709-b72f-479d210be7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a7f13ac-939f-465f-8f1f-843d499e33fc', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895102fb-f4d0-4828-afb6-79f92d6af5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:37:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] Creating offline snapshot a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 of volume bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:37:50 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Volume volume-4a7f13ac-939f-465f-8f1f-843d499e33fc (4a7f13ac-939f-465f-8f1f-843d499e33fc): created successfully Sep 23 12:37:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895102fb-f4d0-4828-afb6-79f92d6af5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:37:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Flow 'volume_create_manager' (49d415b5-b0de-4e4f-b9cc-329b24f953fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:37:50 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f900de98-ed1f-4b0d-8996-af998a38249a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:37:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:50 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ff59c4eb-45a0-4864-b9a1-be34b9008a79 tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Created volume successfully. Sep 23 12:37:51 devstack sudo[91873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 Sep 23 12:37:51 devstack sudo[91873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:51 devstack sudo[91873]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01" returned: 0 in 0.604s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:51 devstack sudo[91880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 1G Sep 23 12:37:51 devstack sudo[91880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:52 devstack sudo[91880]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 1G" returned: 0 in 0.600s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:52 devstack sudo[91887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 Sep 23 12:37:52 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c2a65430-2768-4b29-9b33-b2a39792f87c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:52 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98" returned: 0 in 0.581s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:52 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 12:37:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:52 devstack sudo[91892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 Sep 23 12:37:52 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:53 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98" returned: 0 in 0.555s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:53 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.info Sep 23 12:37:53 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:53 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.info" returned: 0 in 0.479s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:53 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 12:37:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:53 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.info Sep 23 12:37:53 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:54 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.info" returned: 0 in 0.556s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.623s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c2a65430-2768-4b29-9b33-b2a39792f87c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.908s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c2a65430-2768-4b29-9b33-b2a39792f87c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Creating offline snapshot fe29aa73-37a3-4d3e-92c6-ae3f61c6c222 of volume 4a7f13ac-939f-465f-8f1f-843d499e33fc {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:37:54 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dfd638-a188-4ce3-aa62-7500c8a282a3]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:37:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c2a65430-2768-4b29-9b33-b2a39792f87c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:54 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-b6d6c316-6f53-4998-957c-1b84c9ec3437 tempest-GroupSnapshotsTest-1165375712 None] group_snapshot c2581221-a899-48d2-bd2a-15f3d77dd095: created successfully Sep 23 12:37:54 devstack sudo[91941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc Sep 23 12:37:54 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:55 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c2a65430-2768-4b29-9b33-b2a39792f87c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc" returned: 0 in 0.984s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c2a65430-2768-4b29-9b33-b2a39792f87c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:55 devstack sudo[91949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222 1G Sep 23 12:37:55 devstack sudo[91949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:56 devstack sudo[91949]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c2a65430-2768-4b29-9b33-b2a39792f87c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222 1G" returned: 0 in 1.085s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c2a65430-2768-4b29-9b33-b2a39792f87c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a7f13ac-939f-465f-8f1f-843d499e33fc -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:56 devstack sudo[91980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a7f13ac-939f-465f-8f1f-843d499e33fc -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222 Sep 23 12:37:56 devstack sudo[91980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:57 devstack sudo[91980]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c2a65430-2768-4b29-9b33-b2a39792f87c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a7f13ac-939f-465f-8f1f-843d499e33fc -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222" returned: 0 in 0.518s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:57 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-c2a65430-2768-4b29-9b33-b2a39792f87c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222 is being set with open permissions: ugo+rw Sep 23 12:37:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c2a65430-2768-4b29-9b33-b2a39792f87c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:57 devstack sudo[91985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222 Sep 23 12:37:57 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:57 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c2a65430-2768-4b29-9b33-b2a39792f87c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222" returned: 0 in 0.336s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c2a65430-2768-4b29-9b33-b2a39792f87c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:57 devstack sudo[91988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.info Sep 23 12:37:57 devstack sudo[91988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:57 devstack sudo[91988]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c2a65430-2768-4b29-9b33-b2a39792f87c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.info" returned: 0 in 0.330s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:57 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-c2a65430-2768-4b29-9b33-b2a39792f87c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.info is being set with open permissions: ugo+rw Sep 23 12:37:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c2a65430-2768-4b29-9b33-b2a39792f87c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:57 devstack sudo[91991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.info Sep 23 12:37:57 devstack sudo[91991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:58 devstack sudo[91991]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c2a65430-2768-4b29-9b33-b2a39792f87c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.info" returned: 0 in 0.317s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c2a65430-2768-4b29-9b33-b2a39792f87c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.819s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.380s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "cinder-quobyte-a0d36da2-b39e-4f71-aaa9-efe7dfc08d98-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6" by "_create_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-a0d36da2-b39e-4f71-aaa9-efe7dfc08d98-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Creating volume e21242e2-2fb0-4a71-9ead-5b5b5ec632c6 from snapshot a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 {{(pid=86085) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "cinder-quobyte-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6" by "_copy_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:58 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-c2a65430-2768-4b29-9b33-b2a39792f87c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Create snapshot completed successfully Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] snapshot: a0d36da2-b39e-4f71-aaa9-efe7dfc08d98, volume: e21242e2-2fb0-4a71-9ead-5b5b5ec632c6, {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62acb32-c2e2-4bc4-9bc7-e61969c4d285]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:37:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:58 devstack sudo[91994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 Sep 23 12:37:58 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:59 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98" returned: 0 in 0.724s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:37:59 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[443974fa-fada-450f-a883-69767a8b1a65]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:37:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:59 devstack sudo[92022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 Sep 23 12:37:59 devstack sudo[92022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:59 devstack sudo[92022]: pam_unix(sudo:session): session closed for user root Sep 23 12:37:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01" returned: 0 in 0.659s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:37:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] will copy from snapshot at /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 12:37:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Creating direct copy from snapshot {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 12:37:59 devstack cinder-volume[86085]: DEBUG cinder.utils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Path /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6 not found in is_blk_device check {{(pid=86085) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 12:37:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:37:59 devstack sudo[92034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6 Sep 23 12:37:59 devstack sudo[92034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:37:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Acquiring lock "cinder-fe29aa73-37a3-4d3e-92c6-ae3f61c6c222-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Lock "cinder-fe29aa73-37a3-4d3e-92c6-ae3f61c6c222-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Acquiring lock "cinder-quobyte-4a7f13ac-939f-465f-8f1f-843d499e33fc" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Lock "cinder-quobyte-4a7f13ac-939f-465f-8f1f-843d499e33fc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Acquiring lock "cinder-quobyte-fe29aa73-37a3-4d3e-92c6-ae3f61c6c222" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:37:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Lock "cinder-quobyte-fe29aa73-37a3-4d3e-92c6-ae3f61c6c222" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:37:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Deleting offline snapshot fe29aa73-37a3-4d3e-92c6-ae3f61c6c222 of volume 4a7f13ac-939f-465f-8f1f-843d499e33fc {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:37:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] snapshot_file for this snap is: volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:37:59 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f145a38-f6c0-4873-8daa-3a489aa7237a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:37:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:00 devstack sudo[92036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222 Sep 23 12:38:00 devstack sudo[92036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:00 devstack sudo[92036]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222" returned: 0 in 0.474s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a7f13ac-939f-465f-8f1f-843d499e33fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:38:00 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[178d30ed-1902-4817-8989-ea986726f203]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:00 devstack sudo[92052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc Sep 23 12:38:00 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:01 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc" returned: 0 in 0.903s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:01 devstack sudo[92059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222 Sep 23 12:38:01 devstack sudo[92059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:02 devstack sudo[92059]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222" returned: 0 in 1.153s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:02 devstack sudo[92067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222 Sep 23 12:38:02 devstack sudo[92067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:03 devstack sudo[92067]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc.fe29aa73-37a3-4d3e-92c6-ae3f61c6c222" returned: 0 in 0.695s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Lock "cinder-quobyte-fe29aa73-37a3-4d3e-92c6-ae3f61c6c222" released by "_delete_snapshot" :: held 3.533s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Lock "cinder-quobyte-4a7f13ac-939f-465f-8f1f-843d499e33fc" released by "delete_snapshot" :: held 3.576s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:03 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Created reservations ['48b092e0-c494-4a78-8439-230ca7e31933', 'e00f2cbd-fe76-492a-8980-1dbe15f5e7b3', 'e14fc672-09a4-4506-af91-fee2c88657f7', 'eb1cd3b2-f5c1-4e2d-ab6a-d570f9478761'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:38:03 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Delete snapshot completed successfully. Sep 23 12:38:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-495089e9-5a86-4ef1-8f17-89e5aa573c1c tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Lock "cinder-fe29aa73-37a3-4d3e-92c6-ae3f61c6c222-delete_snapshot" released by "delete_snapshot" :: held 3.894s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Acquiring lock "cinder-4a7f13ac-939f-465f-8f1f-843d499e33fc-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Lock "cinder-4a7f13ac-939f-465f-8f1f-843d499e33fc-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Acquiring lock "cinder-quobyte-4a7f13ac-939f-465f-8f1f-843d499e33fc" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Lock "cinder-quobyte-4a7f13ac-939f-465f-8f1f-843d499e33fc" acquired by "delete_volume" :: waited 0.033s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:04 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[231480fe-047c-43c5-a5b4-c749b0a146ea]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:05 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc Sep 23 12:38:05 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:06 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc" returned: 0 in 1.178s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:06 devstack sudo[92076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc Sep 23 12:38:06 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:06 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:38:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Flow 'volume_create_manager' (dd2d4e83-6e0f-4df1-a25b-e3d49ec4fa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:38:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab87d5d-0570-4d40-8e86-24d80a7759f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab87d5d-0570-4d40-8e86-24d80a7759f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-259315229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb4dc2e-042e-4a8d-ba0d-664df0406eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6865f189013f440d8346c6c9ec8eddc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:07Z,use_quota=True,user_id='9e720fcca43749f68bd4b8bf7b72d85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54db6bbc-a86f-47c2-a841-f69546f748b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54db6bbc-a86f-47c2-a841-f69546f748b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93a5e57-ed87-4813-b9a1-fefcd40d4f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93a5e57-ed87-4813-b9a1-fefcd40d4f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cb4dc2e-042e-4a8d-ba0d-664df0406eb3', 'volume_name': 'volume-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcac4e6b-26a3-45f3-a7b2-3feb937d24f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcac4e6b-26a3-45f3-a7b2-3feb937d24f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833cdfb0-ec59-4c35-9589-9c025805ef93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:06 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Volume 6cb4dc2e-042e-4a8d-ba0d-664df0406eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3', 'volume_size': 1} Sep 23 12:38:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:06 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4a7f13ac-939f-465f-8f1f-843d499e33fc" returned: 0 in 0.791s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:06 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Lock "cinder-quobyte-4a7f13ac-939f-465f-8f1f-843d499e33fc" released by "delete_volume" :: held 2.162s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:07 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Created reservations ['7fd0beb1-e530-432c-bc3b-4d04163a38d3', 'aaf72a16-479b-4055-b174-64da448c5a2f', '22e76391-6bf5-4435-b946-da6ad8a4d054', 'e8340c1b-6146-455c-9d66-298dccea57a0'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:38:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:38:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:38:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:07 devstack sudo[92079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:38:07 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:07 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.517s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:07 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:38:07 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Deleted volume successfully. Sep 23 12:38:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f4e4eaea-b61d-40e8-8474-c108489431ab tempest-VolumeSnapshotQuotasNegativeTestJSON-909008810 None] Lock "cinder-4a7f13ac-939f-465f-8f1f-843d499e33fc-delete_volume" released by "delete_volume" :: held 3.232s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:09 devstack sudo[92034]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6" returned: 0 in 9.812s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:09 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Image conversion details: src /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01, size 1024.00 MB, duration 9.81 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6 {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:38:09 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Converted 1024.00 MB image at 104.35 MB/s Sep 23 12:38:09 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 12:38:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:09 devstack sudo[92084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6 Sep 23 12:38:09 devstack sudo[92084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:09 devstack sudo[92084]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6" returned: 0 in 0.325s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6" released by "_copy_volume_from_snapshot" :: held 11.677s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:09 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=92,cinder:INSERT=28,cinder:UPDATE=98,cinder:DELETE=8 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:38:09 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:DELETE=8,cinder:SELECT=66,cinder:INSERT=20,cinder:UPDATE=99 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:38:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-a0d36da2-b39e-4f71-aaa9-efe7dfc08d98-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6" released by "_create_volume_from_snapshot" :: held 11.785s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.819s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.120s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:09 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-259315229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb4dc2e-042e-4a8d-ba0d-664df0406eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6865f189013f440d8346c6c9ec8eddc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:07Z,use_quota=True,user_id='9e720fcca43749f68bd4b8bf7b72d85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:38:09 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Creating volume 6cb4dc2e-042e-4a8d-ba0d-664df0406eb3 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:38:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:09 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:38:09 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:38:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:09 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:38:09 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:38:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:10 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3 1073741824 Sep 23 12:38:10 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:10 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-9bfbc511-a829-4c2a-8291-fbb4f9e46fa6 tempest-GroupSnapshotsTest-1165375712 None] Create group from source-snapshot-c2581221-a899-48d2-bd2a-15f3d77dd095 completed successfully. Sep 23 12:38:10 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3 1073741824" returned: 0 in 0.567s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:10 devstack sudo[92093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3 Sep 23 12:38:10 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:11 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3" returned: 0 in 0.419s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:38:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833cdfb0-ec59-4c35-9589-9c025805ef93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e442f2-88c8-4775-a475-f696d53d0c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:11 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Volume volume-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3 (6cb4dc2e-042e-4a8d-ba0d-664df0406eb3): created successfully Sep 23 12:38:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e442f2-88c8-4775-a475-f696d53d0c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Flow 'volume_create_manager' (dd2d4e83-6e0f-4df1-a25b-e3d49ec4fa48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:38:11 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-31c04d65-d78c-4c43-91bc-200c737adad7 tempest-ServersNegativeTestJSON-845530827 None] Created volume successfully. Sep 23 12:38:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "cinder-quobyte-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6" acquired by "delete_volume" :: waited 0.028s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:11 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e51fdd-97fa-42a4-a9f2-dcb228ff7f56]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:11 devstack sudo[92096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6 Sep 23 12:38:11 devstack sudo[92096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:11 devstack sudo[92096]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6" returned: 0 in 0.484s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:11 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6 Sep 23 12:38:11 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:12 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6" returned: 0 in 0.355s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-e21242e2-2fb0-4a71-9ead-5b5b5ec632c6" released by "delete_volume" :: held 0.907s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:12 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] Created reservations ['b348bbb2-f87c-4811-b7fe-9d4f174254f9'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:38:12 devstack cinder-volume[86085]: WARNING cinder.quota [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1723048341 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1723048341, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:38:12 devstack cinder-volume[86085]: WARNING cinder.quota [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1723048341 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1723048341, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:38:12 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] Created reservations ['175c5fad-ad46-48f6-b4d2-7de8e7cb9a02', 'ec618348-b045-4503-b0db-abe5a6fefdc1', '589b8bef-dfec-43ed-9011-86df60bfaddf', '78e17334-08e6-4a4d-8203-de8f16d32cbb'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:38:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:38:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:38:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:12 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:38:12 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:13 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.383s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:13 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:38:13 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-59f4dd54-806f-4f9c-8367-21766e7bf260 tempest-GroupSnapshotsTest-1165375712 None] Delete group completed successfully. Sep 23 12:38:13 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] group_snapshot c2581221-a899-48d2-bd2a-15f3d77dd095: deleting Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] group_snapshot c2581221-a899-48d2-bd2a-15f3d77dd095: deleting {{(pid=86085) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "cinder-quobyte-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "cinder-quobyte-a0d36da2-b39e-4f71-aaa9-efe7dfc08d98" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-a0d36da2-b39e-4f71-aaa9-efe7dfc08d98" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] Deleting offline snapshot a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 of volume bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] snapshot_file for this snap is: volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da8b70c-8483-486e-8a43-791e7b58a73b]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:38:14 devstack sudo[92108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 Sep 23 12:38:14 devstack sudo[92108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Flow 'volume_create_manager' (3a6e0378-2ead-4022-b40b-bae95c0baca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (486c0f62-3569-43d6-8f07-eb69e9d77393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (486c0f62-3569-43d6-8f07-eb69e9d77393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1168177854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27221791-9392-4e66-a61b-c4eae9a38fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6865f189013f440d8346c6c9ec8eddc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:14Z,use_quota=True,user_id='9e720fcca43749f68bd4b8bf7b72d85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec31fb7-727d-439d-afbb-943f879704fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec31fb7-727d-439d-afbb-943f879704fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6078d84f-6022-404a-aab0-0878601c1b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6078d84f-6022-404a-aab0-0878601c1b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27221791-9392-4e66-a61b-c4eae9a38fd2', 'volume_name': 'volume-27221791-9392-4e66-a61b-c4eae9a38fd2', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1230232d-35f9-4a3a-8f3a-357472892ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1230232d-35f9-4a3a-8f3a-357472892ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1275ea-3a05-401b-810f-f00ef975f68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:14 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Volume 27221791-9392-4e66-a61b-c4eae9a38fd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27221791-9392-4e66-a61b-c4eae9a38fd2', 'volume_size': 1} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1168177854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27221791-9392-4e66-a61b-c4eae9a38fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6865f189013f440d8346c6c9ec8eddc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:14Z,use_quota=True,user_id='9e720fcca43749f68bd4b8bf7b72d85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Creating volume 27221791-9392-4e66-a61b-c4eae9a38fd2 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:38:14 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27221791-9392-4e66-a61b-c4eae9a38fd2 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:14 devstack sudo[92110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27221791-9392-4e66-a61b-c4eae9a38fd2 1073741824 Sep 23 12:38:14 devstack sudo[92110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:14 devstack sudo[92108]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98" returned: 0 in 0.540s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb789cfd-f0c5-4326-a387-7880d31c5a16]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:14 devstack sudo[92115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 Sep 23 12:38:14 devstack sudo[92115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:15 devstack sudo[92110]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27221791-9392-4e66-a61b-c4eae9a38fd2 1073741824" returned: 0 in 0.722s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27221791-9392-4e66-a61b-c4eae9a38fd2 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:15 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27221791-9392-4e66-a61b-c4eae9a38fd2 Sep 23 12:38:15 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:15 devstack sudo[92115]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01" returned: 0 in 0.831s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:15 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27221791-9392-4e66-a61b-c4eae9a38fd2" returned: 0 in 0.369s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:38:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:15 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 Sep 23 12:38:15 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1275ea-3a05-401b-810f-f00ef975f68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27221791-9392-4e66-a61b-c4eae9a38fd2', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce15bb3e-2da3-4482-8171-5ef244f58bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:15 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Volume volume-27221791-9392-4e66-a61b-c4eae9a38fd2 (27221791-9392-4e66-a61b-c4eae9a38fd2): created successfully Sep 23 12:38:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce15bb3e-2da3-4482-8171-5ef244f58bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Flow 'volume_create_manager' (3a6e0378-2ead-4022-b40b-bae95c0baca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:38:15 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ddd6b0ed-cbc9-452b-8404-11659f7971b2 tempest-ServersNegativeTestJSON-845530827 None] Created volume successfully. Sep 23 12:38:16 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98" returned: 0 in 0.469s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:16 devstack sudo[92133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98 Sep 23 12:38:16 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:16 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01.a0d36da2-b39e-4f71-aaa9-efe7dfc08d98" returned: 0 in 0.507s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:16 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-a0d36da2-b39e-4f71-aaa9-efe7dfc08d98" released by "_delete_snapshot" :: held 2.531s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:16 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01" released by "delete_snapshot" :: held 2.574s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:16 devstack cinder-volume[86085]: WARNING cinder.quota [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1723048341 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1723048341, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:38:16 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] Created reservations ['321ed61d-0170-4b0b-bd7d-eeea34618af1', '09cc5d28-3c82-4a78-b895-3f81e917e5b2', '93741570-42e5-409d-ba19-5d0a75ba9ad6', 'd73eb692-2cc0-4762-b4c0-888f53aa43ff'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:38:16 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ad10345b-b244-4d33-8ca3-4a741d9ba43d tempest-GroupSnapshotsTest-1165375712 None] group_snapshot c2581221-a899-48d2-bd2a-15f3d77dd095: deleted successfully Sep 23 12:38:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] Acquiring lock "cinder-27221791-9392-4e66-a61b-c4eae9a38fd2-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] Lock "cinder-27221791-9392-4e66-a61b-c4eae9a38fd2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] Acquiring lock "cinder-quobyte-27221791-9392-4e66-a61b-c4eae9a38fd2" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] Lock "cinder-quobyte-27221791-9392-4e66-a61b-c4eae9a38fd2" acquired by "delete_volume" :: waited 0.031s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:17 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be6282e-1387-4379-8493-92b4d0688b33]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27221791-9392-4e66-a61b-c4eae9a38fd2 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:17 devstack sudo[92137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27221791-9392-4e66-a61b-c4eae9a38fd2 Sep 23 12:38:17 devstack sudo[92137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d0127eb7-7a60-472d-b9f4-4f2c37537c3c tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "cinder-quobyte-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:17 devstack sudo[92137]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27221791-9392-4e66-a61b-c4eae9a38fd2" returned: 0 in 0.519s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27221791-9392-4e66-a61b-c4eae9a38fd2 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d0127eb7-7a60-472d-b9f4-4f2c37537c3c tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01" acquired by "delete_volume" :: waited 0.069s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:17 devstack sudo[92142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27221791-9392-4e66-a61b-c4eae9a38fd2 Sep 23 12:38:17 devstack sudo[92142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:17 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcc4e50-1335-439d-9f33-f314c96b1786]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d0127eb7-7a60-472d-b9f4-4f2c37537c3c tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:18 devstack sudo[92144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 Sep 23 12:38:18 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:18 devstack sudo[92142]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27221791-9392-4e66-a61b-c4eae9a38fd2" returned: 0 in 0.365s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] Lock "cinder-quobyte-27221791-9392-4e66-a61b-c4eae9a38fd2" released by "delete_volume" :: held 0.960s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:18 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] Created reservations ['b58a1e6d-63bc-4a5f-a814-800595be4da7', '6b1c0683-b51d-4a63-921a-1a9111ab9277', '8e97cbce-f5fe-4659-bce5-fb17191b10d8', '6470a709-3fc9-4be0-b197-6d733bbf3045'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:38:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:38:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:38:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:18 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:38:18 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:18 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d0127eb7-7a60-472d-b9f4-4f2c37537c3c tempest-GroupSnapshotsTest-1165375712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01" returned: 0 in 0.552s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d0127eb7-7a60-472d-b9f4-4f2c37537c3c tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:18 devstack sudo[92153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01 Sep 23 12:38:18 devstack sudo[92153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:18 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.318s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:18 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:38:18 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] Deleted volume successfully. Sep 23 12:38:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e02142b3-7b85-4791-b724-facfad6b5f75 tempest-ServersNegativeTestJSON-845530827 None] Lock "cinder-27221791-9392-4e66-a61b-c4eae9a38fd2-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:18 devstack sudo[92153]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d0127eb7-7a60-472d-b9f4-4f2c37537c3c tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01" returned: 0 in 0.402s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d0127eb7-7a60-472d-b9f4-4f2c37537c3c tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-bbb64ff4-eca1-4e6a-b8b0-c302f0b32f01" released by "delete_volume" :: held 1.074s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:18 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-d0127eb7-7a60-472d-b9f4-4f2c37537c3c tempest-GroupSnapshotsTest-1165375712 None] Created reservations ['87dde465-78ad-4071-ab75-426e7cf0e80d'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:38:18 devstack cinder-volume[86085]: WARNING cinder.db.api [None req-d0127eb7-7a60-472d-b9f4-4f2c37537c3c tempest-GroupSnapshotsTest-1165375712 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1723048341'] Sep 23 12:38:19 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-d0127eb7-7a60-472d-b9f4-4f2c37537c3c tempest-GroupSnapshotsTest-1165375712 None] Created reservations ['464cd75b-4b36-4e65-811c-e0c774561d0b', 'ebc2bf1b-7131-41c4-8f99-2f19a9af2330', 'b73b7b09-f80c-421c-9cad-b46ac93f07bf', 'f06011f9-8740-4543-b378-57604a22be23'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:38:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d0127eb7-7a60-472d-b9f4-4f2c37537c3c tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d0127eb7-7a60-472d-b9f4-4f2c37537c3c tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d0127eb7-7a60-472d-b9f4-4f2c37537c3c tempest-GroupSnapshotsTest-1165375712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:38:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d0127eb7-7a60-472d-b9f4-4f2c37537c3c tempest-GroupSnapshotsTest-1165375712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:38:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d0127eb7-7a60-472d-b9f4-4f2c37537c3c tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d0127eb7-7a60-472d-b9f4-4f2c37537c3c tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:19 devstack sudo[92157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:38:19 devstack sudo[92157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] Acquiring lock "cinder-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] Lock "cinder-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:19 devstack sudo[92157]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d0127eb7-7a60-472d-b9f4-4f2c37537c3c tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.316s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:19 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-d0127eb7-7a60-472d-b9f4-4f2c37537c3c tempest-GroupSnapshotsTest-1165375712 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:38:19 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d0127eb7-7a60-472d-b9f4-4f2c37537c3c tempest-GroupSnapshotsTest-1165375712 None] Delete group completed successfully. Sep 23 12:38:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] Acquiring lock "cinder-quobyte-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] Lock "cinder-quobyte-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3" acquired by "delete_volume" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:19 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[99715b9b-84c8-499d-a07d-ebc460d4f90c]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:19 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3 Sep 23 12:38:19 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:20 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3" returned: 0 in 0.432s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:20 devstack sudo[92168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3 Sep 23 12:38:20 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:20 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3" returned: 0 in 0.299s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:20 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] Lock "cinder-quobyte-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3" released by "delete_volume" :: held 0.827s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:20 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] Created reservations ['30f389a9-64fa-4099-8cdb-c68e7e31d7cd', 'd92c77cb-5a51-474e-9eae-e5d9ab7fbf3b', '16b3e77e-4414-4032-b251-2c1879c096b0', '63bf8cb0-9df2-4279-865b-be34aff2f9a0'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:38:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:20 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:38:20 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:38:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:20 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:38:20 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:20 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-35a3545b-2259-4ad6-a548-bb8aab94cdaa tempest-GroupSnapshotsTest-1165375712 None] Group tempest-GroupSnapshotsTest-Group-1392082794: creating Sep 23 12:38:20 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-35a3545b-2259-4ad6-a548-bb8aab94cdaa tempest-GroupSnapshotsTest-1165375712 None] Group tempest-GroupSnapshotsTest-Group-1392082794: created successfully Sep 23 12:38:20 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-35a3545b-2259-4ad6-a548-bb8aab94cdaa tempest-GroupSnapshotsTest-1165375712 None] Create group completed successfully. Sep 23 12:38:21 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.514s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:21 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:38:21 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] Deleted volume successfully. Sep 23 12:38:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9f87989f-cd02-416b-ab4b-3e57b165ebfb tempest-ServersNegativeTestJSON-845530827 None] Lock "cinder-6cb4dc2e-042e-4a8d-ba0d-664df0406eb3-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Flow 'volume_create_manager' (03930dc3-9404-4060-a754-5c4f80666da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de63f461-ce8f-4ffd-bbdf-9fde622bbcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de63f461-ce8f-4ffd-bbdf-9fde622bbcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1065619867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23d71a99-4936-4142-b556-c6e19dfb1314,host='devstack@QuobyteHD#QuobyteHD',id=32726f1b-9dba-44e7-8dfb-6441dfe213a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9168358ddb434985934015f1d67af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:23Z,use_quota=True,user_id='c16b8034c7414f49af59e7bbcf30c0aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6505060-fde1-4bb8-80c7-ad3aace9f1b6),volume_type_id=e6505060-fde1-4bb8-80c7-ad3aace9f1b6)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb07b2e-5271-4eda-8192-1508de65a6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb07b2e-5271-4eda-8192-1508de65a6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d1be15-8fbf-4ec0-88cb-5d0c2662eda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d1be15-8fbf-4ec0-88cb-5d0c2662eda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32726f1b-9dba-44e7-8dfb-6441dfe213a4', 'volume_name': 'volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4164d4-73d3-4348-b348-dec5d789247d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4164d4-73d3-4348-b348-dec5d789247d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94739594-1780-411a-b97a-61507546384a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:23 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Volume 32726f1b-9dba-44e7-8dfb-6441dfe213a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4', 'volume_size': 1} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=23d71a99-4936-4142-b556-c6e19dfb1314,created_at=2026-09-23T10:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1065619867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23d71a99-4936-4142-b556-c6e19dfb1314,host='devstack@QuobyteHD#QuobyteHD',id=32726f1b-9dba-44e7-8dfb-6441dfe213a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9168358ddb434985934015f1d67af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:23Z,use_quota=True,user_id='c16b8034c7414f49af59e7bbcf30c0aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6505060-fde1-4bb8-80c7-ad3aace9f1b6),volume_type_id=e6505060-fde1-4bb8-80c7-ad3aace9f1b6)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Creating volume 32726f1b-9dba-44e7-8dfb-6441dfe213a4 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:38:23 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:23 devstack sudo[92203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4 1073741824 Sep 23 12:38:23 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Flow 'volume_create_manager' (eec3f9a0-f577-44c2-9db3-3f1c6ebff3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665c16bc-6e0a-4165-a57d-67bcdaab20cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665c16bc-6e0a-4165-a57d-67bcdaab20cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1654833799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4eeb04-1093-44e9-8aa0-4b8277e00651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2331acd306342c891bb568e4792373a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:24Z,use_quota=True,user_id='b4eabbe85ca047419333b8b8bb936c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d14ef5e-6966-432d-862c-0a53dc842719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d14ef5e-6966-432d-862c-0a53dc842719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83040b3-882f-4c54-9916-a6fa11ac7fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83040b3-882f-4c54-9916-a6fa11ac7fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4eeb04-1093-44e9-8aa0-4b8277e00651', 'volume_name': 'volume-2c4eeb04-1093-44e9-8aa0-4b8277e00651', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6833b374-f3c1-4b81-92e9-b8d195751c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6833b374-f3c1-4b81-92e9-b8d195751c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5b8162-d98c-4ed8-a11d-410b832f9f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:23 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Volume 2c4eeb04-1093-44e9-8aa0-4b8277e00651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4eeb04-1093-44e9-8aa0-4b8277e00651', 'volume_size': 1} Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:23 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4 1073741824" returned: 0 in 0.690s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:24 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4 Sep 23 12:38:24 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:24 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4" returned: 0 in 0.295s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:38:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.471s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1654833799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4eeb04-1093-44e9-8aa0-4b8277e00651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2331acd306342c891bb568e4792373a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:24Z,use_quota=True,user_id='b4eabbe85ca047419333b8b8bb936c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:38:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Creating volume 2c4eeb04-1093-44e9-8aa0-4b8277e00651 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:38:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:38:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:38:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:38:24 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:38:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2c4eeb04-1093-44e9-8aa0-4b8277e00651 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:24 devstack sudo[92213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2c4eeb04-1093-44e9-8aa0-4b8277e00651 1073741824 Sep 23 12:38:24 devstack sudo[92213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94739594-1780-411a-b97a-61507546384a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0feee13-b103-4760-a958-094082109ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:24 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Volume volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4 (32726f1b-9dba-44e7-8dfb-6441dfe213a4): created successfully Sep 23 12:38:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0feee13-b103-4760-a958-094082109ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Flow 'volume_create_manager' (03930dc3-9404-4060-a754-5c4f80666da5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:38:24 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0eada9b8-a5f3-43ad-b6aa-ff11fe33fe6e tempest-GroupSnapshotsTest-1165375712 None] Created volume successfully. Sep 23 12:38:25 devstack sudo[92213]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2c4eeb04-1093-44e9-8aa0-4b8277e00651 1073741824" returned: 0 in 0.721s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2c4eeb04-1093-44e9-8aa0-4b8277e00651 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:25 devstack sudo[92224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2c4eeb04-1093-44e9-8aa0-4b8277e00651 Sep 23 12:38:25 devstack sudo[92224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:25 devstack sudo[92224]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2c4eeb04-1093-44e9-8aa0-4b8277e00651" returned: 0 in 0.331s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:38:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5b8162-d98c-4ed8-a11d-410b832f9f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4eeb04-1093-44e9-8aa0-4b8277e00651', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecff0411-d161-423b-be73-bef97658e510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:25 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Volume volume-2c4eeb04-1093-44e9-8aa0-4b8277e00651 (2c4eeb04-1093-44e9-8aa0-4b8277e00651): created successfully Sep 23 12:38:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecff0411-d161-423b-be73-bef97658e510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Flow 'volume_create_manager' (eec3f9a0-f577-44c2-9db3-3f1c6ebff3a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:38:25 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d862f26d-2e34-4414-8398-90ed9da58f9a tempest-VolumesTransfersV357Test-175179150 None] Created volume successfully. Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Flow 'volume_create_manager' (8905841a-3393-420d-bbf2-d54c9049ee1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f0d718-8094-41f7-b653-9e007f87cca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f0d718-8094-41f7-b653-9e007f87cca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1752394861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23d71a99-4936-4142-b556-c6e19dfb1314,host='devstack@QuobyteHD#QuobyteHD',id=202ba92d-4f1b-41d4-a1e9-528602b30a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9168358ddb434985934015f1d67af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:26Z,use_quota=True,user_id='c16b8034c7414f49af59e7bbcf30c0aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6505060-fde1-4bb8-80c7-ad3aace9f1b6),volume_type_id=e6505060-fde1-4bb8-80c7-ad3aace9f1b6)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149e8f43-9e46-4eab-9cd4-20b9fb08ce88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149e8f43-9e46-4eab-9cd4-20b9fb08ce88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3728ebd-1856-4dfe-86d6-d74c05000bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3728ebd-1856-4dfe-86d6-d74c05000bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '202ba92d-4f1b-41d4-a1e9-528602b30a25', 'volume_name': 'volume-202ba92d-4f1b-41d4-a1e9-528602b30a25', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183d980d-22e2-4162-a304-b97962075590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183d980d-22e2-4162-a304-b97962075590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483c68e2-74ee-4a3b-8deb-5a49d219b774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:26 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Volume 202ba92d-4f1b-41d4-a1e9-528602b30a25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-202ba92d-4f1b-41d4-a1e9-528602b30a25', 'volume_size': 1} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=23d71a99-4936-4142-b556-c6e19dfb1314,created_at=2026-09-23T10:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1752394861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23d71a99-4936-4142-b556-c6e19dfb1314,host='devstack@QuobyteHD#QuobyteHD',id=202ba92d-4f1b-41d4-a1e9-528602b30a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9168358ddb434985934015f1d67af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:26Z,use_quota=True,user_id='c16b8034c7414f49af59e7bbcf30c0aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6505060-fde1-4bb8-80c7-ad3aace9f1b6),volume_type_id=e6505060-fde1-4bb8-80c7-ad3aace9f1b6)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Creating volume 202ba92d-4f1b-41d4-a1e9-528602b30a25 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:38:26 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:38:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:26 devstack sudo[92276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25 1073741824 Sep 23 12:38:26 devstack sudo[92276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:26 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-7f630318-e793-4055-af55-93ab5d10a0f5 tempest-VolumesTransfersV357Test-947584115 None] Transfer volume completed successfully. Sep 23 12:38:27 devstack sudo[92276]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25 1073741824" returned: 0 in 0.700s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:27 devstack sudo[92284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25 Sep 23 12:38:27 devstack sudo[92284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] Acquiring lock "cinder-2c4eeb04-1093-44e9-8aa0-4b8277e00651-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] Lock "cinder-2c4eeb04-1093-44e9-8aa0-4b8277e00651-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:27 devstack sudo[92284]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25" returned: 0 in 0.392s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:38:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] Acquiring lock "cinder-quobyte-2c4eeb04-1093-44e9-8aa0-4b8277e00651" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483c68e2-74ee-4a3b-8deb-5a49d219b774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-202ba92d-4f1b-41d4-a1e9-528602b30a25', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e2e9e9-1b2f-43bd-8100-f9b303469a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] Lock "cinder-quobyte-2c4eeb04-1093-44e9-8aa0-4b8277e00651" acquired by "delete_volume" :: waited 0.044s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:27 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[410f1c4b-e39b-494a-a827-701f6a7a895b]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2c4eeb04-1093-44e9-8aa0-4b8277e00651 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:27 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Volume volume-202ba92d-4f1b-41d4-a1e9-528602b30a25 (202ba92d-4f1b-41d4-a1e9-528602b30a25): created successfully Sep 23 12:38:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e2e9e9-1b2f-43bd-8100-f9b303469a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Flow 'volume_create_manager' (8905841a-3393-420d-bbf2-d54c9049ee1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:38:27 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-b3087138-614f-4aef-bcd3-256baaaf4f29 tempest-GroupSnapshotsTest-1165375712 None] Created volume successfully. Sep 23 12:38:28 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2c4eeb04-1093-44e9-8aa0-4b8277e00651 Sep 23 12:38:28 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:28 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2c4eeb04-1093-44e9-8aa0-4b8277e00651" returned: 0 in 0.464s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2c4eeb04-1093-44e9-8aa0-4b8277e00651 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:28 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2c4eeb04-1093-44e9-8aa0-4b8277e00651 Sep 23 12:38:28 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:28 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2c4eeb04-1093-44e9-8aa0-4b8277e00651" returned: 0 in 0.302s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:28 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] Lock "cinder-quobyte-2c4eeb04-1093-44e9-8aa0-4b8277e00651" released by "delete_volume" :: held 0.825s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:28 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] Created reservations ['4e2cc10a-42cb-4f77-a3f7-ccb5d90ae12c', '6506d25c-83cc-4f75-a412-0dd2133d563a', '01e88040-57db-4430-bc31-4b6357da0232', '25d4968d-cb00-4c9e-999f-e4952a44aa55'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:38:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:28 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:38:28 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:38:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:28 devstack sudo[92296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:38:28 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:29 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.523s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:29 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:38:29 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] Deleted volume successfully. Sep 23 12:38:29 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5dc78557-106c-401c-9265-71c8fec272dc tempest-VolumesTransfersV357Test-2028947811 None] Lock "cinder-2c4eeb04-1093-44e9-8aa0-4b8277e00651-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:29 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-7ec1fb72-2e25-458c-802d-c18f8560b376 tempest-GroupSnapshotsTest-1165375712 None] Update group completed successfully. Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Flow 'volume_create_manager' (4c10568e-a351-42b4-b3f9-6a973b40f951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493cf35f-2199-473f-ad2f-119068a4c2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493cf35f-2199-473f-ad2f-119068a4c2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1121547276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deeb7070-0220-4dfe-8242-171d0a356927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2331acd306342c891bb568e4792373a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:30Z,use_quota=True,user_id='b4eabbe85ca047419333b8b8bb936c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87db80a7-3d0d-41fd-b116-33a108eed9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87db80a7-3d0d-41fd-b116-33a108eed9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf8d165-1f40-4f27-a7af-562afaee1008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf8d165-1f40-4f27-a7af-562afaee1008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deeb7070-0220-4dfe-8242-171d0a356927', 'volume_name': 'volume-deeb7070-0220-4dfe-8242-171d0a356927', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a62fe203-1a23-455c-b2a7-6daedaabfa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a62fe203-1a23-455c-b2a7-6daedaabfa2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7589400f-3e5c-4a4f-ae04-b4c76568eb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:30 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Volume deeb7070-0220-4dfe-8242-171d0a356927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deeb7070-0220-4dfe-8242-171d0a356927', 'volume_size': 1} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1121547276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deeb7070-0220-4dfe-8242-171d0a356927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2331acd306342c891bb568e4792373a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:30Z,use_quota=True,user_id='b4eabbe85ca047419333b8b8bb936c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Creating volume deeb7070-0220-4dfe-8242-171d0a356927 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:38:30 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:38:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-deeb7070-0220-4dfe-8242-171d0a356927 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:30 devstack sudo[92365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-deeb7070-0220-4dfe-8242-171d0a356927 1073741824 Sep 23 12:38:30 devstack sudo[92365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:31 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-3ad47b63-5274-45aa-b82d-3c7b75332fb5 tempest-GroupSnapshotsTest-1165375712 None] Update group completed successfully. Sep 23 12:38:31 devstack sudo[92365]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-deeb7070-0220-4dfe-8242-171d0a356927 1073741824" returned: 0 in 0.965s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-deeb7070-0220-4dfe-8242-171d0a356927 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:31 devstack sudo[92375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-deeb7070-0220-4dfe-8242-171d0a356927 Sep 23 12:38:31 devstack sudo[92375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:32 devstack sudo[92375]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-deeb7070-0220-4dfe-8242-171d0a356927" returned: 0 in 0.382s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:38:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7589400f-3e5c-4a4f-ae04-b4c76568eb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deeb7070-0220-4dfe-8242-171d0a356927', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c1acf0-442c-4850-af9a-df134792ff8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:32 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Volume volume-deeb7070-0220-4dfe-8242-171d0a356927 (deeb7070-0220-4dfe-8242-171d0a356927): created successfully Sep 23 12:38:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c1acf0-442c-4850-af9a-df134792ff8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Flow 'volume_create_manager' (4c10568e-a351-42b4-b3f9-6a973b40f951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:38:32 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-666c78fe-c011-45e8-8ac7-4e6f5c1ac4a3 tempest-VolumesTransfersV357Test-175179150 None] Created volume successfully. Sep 23 12:38:32 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-07bb4e52-f76b-4fa9-a43b-ac0ace528ca7 tempest-GroupSnapshotsTest-1165375712 None] Update group completed successfully. Sep 23 12:38:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] Acquiring lock "cinder-deeb7070-0220-4dfe-8242-171d0a356927-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] Lock "cinder-deeb7070-0220-4dfe-8242-171d0a356927-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] Acquiring lock "cinder-quobyte-deeb7070-0220-4dfe-8242-171d0a356927" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] Lock "cinder-quobyte-deeb7070-0220-4dfe-8242-171d0a356927" acquired by "delete_volume" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:33 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[da963811-1a8b-47bc-9bb0-d19449dee415]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-deeb7070-0220-4dfe-8242-171d0a356927 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:33 devstack sudo[92379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-deeb7070-0220-4dfe-8242-171d0a356927 Sep 23 12:38:33 devstack sudo[92379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:33 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-7adf933e-4cfa-4555-9c8e-60a4822ae17c tempest-GroupSnapshotsTest-1165375712 None] Update group completed successfully. Sep 23 12:38:33 devstack sudo[92379]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-deeb7070-0220-4dfe-8242-171d0a356927" returned: 0 in 0.743s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-deeb7070-0220-4dfe-8242-171d0a356927 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:33 devstack sudo[92385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-deeb7070-0220-4dfe-8242-171d0a356927 Sep 23 12:38:33 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:34 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-deeb7070-0220-4dfe-8242-171d0a356927" returned: 0 in 0.419s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] Lock "cinder-quobyte-deeb7070-0220-4dfe-8242-171d0a356927" released by "delete_volume" :: held 1.237s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:34 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] Created reservations ['df0565f8-f9ef-4715-9160-7c881b5a6cd8', '1c95b2c9-f0b1-4648-bbb2-f9e243aa39dd', 'cdd1823c-5982-4a83-bb2b-7abedbf494f6', '6c1114d0-465b-47cf-aa20-da3d507701b8'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:38:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:38:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:38:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:34 devstack sudo[92389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:38:34 devstack sudo[92389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:34 devstack sudo[92389]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.346s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:34 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:38:34 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] Deleted volume successfully. Sep 23 12:38:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-91dffed8-2243-4d87-91ce-2d33fa5e26c8 tempest-VolumesTransfersV357Test-2028947811 None] Lock "cinder-deeb7070-0220-4dfe-8242-171d0a356927-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:35 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] GroupSnapshot e73f6623-56b6-4530-b6b0-86da4a2f91ce: creating. Sep 23 12:38:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Group snapshot e73f6623-56b6-4530-b6b0-86da4a2f91ce: creating. {{(pid=86085) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 12:38:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Creating offline snapshot 0dd7792d-14e7-486e-a26a-a38d34ba430b of volume 32726f1b-9dba-44e7-8dfb-6441dfe213a4 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:38:35 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad28855-e904-43fd-9a82-39142c2dab98]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:35 devstack sudo[92393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4 Sep 23 12:38:35 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:36 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4" returned: 0 in 0.559s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:36 devstack sudo[92398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b 1G Sep 23 12:38:36 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:36 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b 1G" returned: 0 in 0.644s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:36 devstack sudo[92403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b Sep 23 12:38:36 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:37 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b" returned: 0 in 0.369s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:37 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b is being set with open permissions: ugo+rw: NotImplementedError Sep 23 12:38:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:37 devstack sudo[92409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b Sep 23 12:38:37 devstack sudo[92409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:37 devstack sudo[92409]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b" returned: 0 in 0.351s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:37 devstack sudo[92412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.info Sep 23 12:38:37 devstack sudo[92412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:37 devstack sudo[92412]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.info" returned: 0 in 0.385s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:38 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 12:38:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:38 devstack sudo[92415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.info Sep 23 12:38:38 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:38 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.info" returned: 0 in 0.353s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.828s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Creating offline snapshot db633a1e-cb9d-4e8d-907a-1ca0a3503074 of volume 202ba92d-4f1b-41d4-a1e9-528602b30a25 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:38:38 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[281382a5-7ddb-4893-9cfa-0fe3bbac9a85]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:38 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-680e2802-4eab-44cb-916c-85bc296f7402 tempest-GroupSnapshotsV319Test-1025807562 None] Group tempest-GroupSnapshotsV319Test-Group-1574392362: creating Sep 23 12:38:38 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-680e2802-4eab-44cb-916c-85bc296f7402 tempest-GroupSnapshotsV319Test-1025807562 None] Group tempest-GroupSnapshotsV319Test-Group-1574392362: created successfully Sep 23 12:38:38 devstack sudo[92418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25 Sep 23 12:38:38 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:38 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-680e2802-4eab-44cb-916c-85bc296f7402 tempest-GroupSnapshotsV319Test-1025807562 None] Create group completed successfully. Sep 23 12:38:38 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25" returned: 0 in 0.568s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:39 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074 1G Sep 23 12:38:39 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:39 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074 1G" returned: 0 in 0.492s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-202ba92d-4f1b-41d4-a1e9-528602b30a25 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:39 devstack sudo[92429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-202ba92d-4f1b-41d4-a1e9-528602b30a25 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074 Sep 23 12:38:39 devstack sudo[92429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:39 devstack sudo[92429]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-202ba92d-4f1b-41d4-a1e9-528602b30a25 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074" returned: 0 in 0.450s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:39 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 12:38:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:39 devstack sudo[92435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074 Sep 23 12:38:39 devstack sudo[92435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:40 devstack sudo[92435]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074" returned: 0 in 0.514s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:40 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:38:40 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.info Sep 23 12:38:40 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Flow 'volume_create_manager' (1c11361f-bdf0-410a-93cd-bc976361c971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:38:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c83d641-8482-49ef-8f6e-884126e93b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c83d641-8482-49ef-8f6e-884126e93b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1224790335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=af66cb35-1da0-486b-aba7-80bb37ed3f30,host='devstack@QuobyteHD#QuobyteHD',id=b40172c5-6d45-4528-b468-ca65f5f795a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f581afdfdd4bc395ad39b16a954475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:40Z,use_quota=True,user_id='5d624592f1c44f209ce0bf64fce0e4b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a54c885-53f6-427b-96d0-e9952ad60306),volume_type_id=5a54c885-53f6-427b-96d0-e9952ad60306)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1cd132-cc22-458c-a7a8-1f5557798863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1cd132-cc22-458c-a7a8-1f5557798863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e670c053-6b53-4453-8977-e097b94dcaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e670c053-6b53-4453-8977-e097b94dcaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b40172c5-6d45-4528-b468-ca65f5f795a3', 'volume_name': 'volume-b40172c5-6d45-4528-b468-ca65f5f795a3', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169c5df3-df71-49a6-a7ca-634148256f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169c5df3-df71-49a6-a7ca-634148256f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa232fe3-f2a1-40a7-9097-357ff283b01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:40 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Volume b40172c5-6d45-4528-b468-ca65f5f795a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b40172c5-6d45-4528-b468-ca65f5f795a3', 'volume_size': 1} Sep 23 12:38:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:40 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.info" returned: 0 in 0.426s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:40 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 12:38:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:40 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.info Sep 23 12:38:40 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:41 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.info" returned: 0 in 0.260s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.846s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.544s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=af66cb35-1da0-486b-aba7-80bb37ed3f30,created_at=2026-09-23T10:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1224790335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=af66cb35-1da0-486b-aba7-80bb37ed3f30,host='devstack@QuobyteHD#QuobyteHD',id=b40172c5-6d45-4528-b468-ca65f5f795a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f581afdfdd4bc395ad39b16a954475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:40Z,use_quota=True,user_id='5d624592f1c44f209ce0bf64fce0e4b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a54c885-53f6-427b-96d0-e9952ad60306),volume_type_id=5a54c885-53f6-427b-96d0-e9952ad60306)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Creating volume b40172c5-6d45-4528-b468-ca65f5f795a3 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:38:41 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:41 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3 1073741824 Sep 23 12:38:41 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:41 devstack sudo[92447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:38:41 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:41 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-833bb86c-5894-48af-be3a-08963d095ed2 tempest-GroupSnapshotsTest-1165375712 None] group_snapshot e73f6623-56b6-4530-b6b0-86da4a2f91ce: created successfully Sep 23 12:38:41 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.466s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:38:41 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3 1073741824" returned: 0 in 0.713s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:42 devstack sudo[92454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3 Sep 23 12:38:42 devstack sudo[92454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:42 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] group_snapshot e73f6623-56b6-4530-b6b0-86da4a2f91ce: deleting Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] group_snapshot e73f6623-56b6-4530-b6b0-86da4a2f91ce: deleting {{(pid=86085) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "cinder-quobyte-32726f1b-9dba-44e7-8dfb-6441dfe213a4" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-32726f1b-9dba-44e7-8dfb-6441dfe213a4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "cinder-quobyte-0dd7792d-14e7-486e-a26a-a38d34ba430b" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-0dd7792d-14e7-486e-a26a-a38d34ba430b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Deleting offline snapshot 0dd7792d-14e7-486e-a26a-a38d34ba430b of volume 32726f1b-9dba-44e7-8dfb-6441dfe213a4 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] snapshot_file for this snap is: volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d3cfe8-95fe-40d5-9ae0-cfb17faaa5de]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:42 devstack sudo[92454]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3" returned: 0 in 0.384s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa232fe3-f2a1-40a7-9097-357ff283b01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b40172c5-6d45-4528-b468-ca65f5f795a3', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97078037-bbb9-4e68-92a4-c9a1a47e028b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:42 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Volume volume-b40172c5-6d45-4528-b468-ca65f5f795a3 (b40172c5-6d45-4528-b468-ca65f5f795a3): created successfully Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97078037-bbb9-4e68-92a4-c9a1a47e028b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Flow 'volume_create_manager' (1c11361f-bdf0-410a-93cd-bc976361c971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:38:42 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-e70fe959-3f6f-4a8d-be13-fc3d8a4894bc tempest-GroupSnapshotsV319Test-1025807562 None] Created volume successfully. Sep 23 12:38:42 devstack sudo[92457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b Sep 23 12:38:42 devstack sudo[92457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:42 devstack sudo[92457]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b" returned: 0 in 0.488s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b2266d-cc00-41cb-807f-4909ed08be10]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:43 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4 Sep 23 12:38:43 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:43 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] GroupSnapshot 59e032e9-7e05-4e9d-a922-6f6461ce5b52: creating. Sep 23 12:38:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] Group snapshot 59e032e9-7e05-4e9d-a922-6f6461ce5b52: creating. {{(pid=86085) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 12:38:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] Creating offline snapshot 288b53c8-1fc0-41c4-931b-c8c4aa4a3628 of volume b40172c5-6d45-4528-b468-ca65f5f795a3 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:38:43 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[81da812f-4b3a-4bc7-adec-a5cf680e2901]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:43 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4" returned: 0 in 0.590s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:43 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b Sep 23 12:38:43 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:43 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3 Sep 23 12:38:43 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:43 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3" returned: 0 in 0.511s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:43 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b" returned: 0 in 0.518s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:43 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628 1G Sep 23 12:38:44 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:44 devstack sudo[92507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b Sep 23 12:38:44 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Flow 'volume_create_manager' (d3dfb36c-df92-4dd5-b3bc-f4ba6e32a303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a148b02-5ec3-443f-9615-47ba21b4afe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a148b02-5ec3-443f-9615-47ba21b4afe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-183549098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f63d1c-12a6-4b27-8d60-28efc0dfdcbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dfc1082f7874d499d1d2cf815143200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:44Z,use_quota=True,user_id='c4c7b4020551450d9c0f58893335e270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33b5caa-964b-4ec8-8df3-66513647faea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33b5caa-964b-4ec8-8df3-66513647faea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2124f0fc-db46-4044-8aed-d036b6dff9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2124f0fc-db46-4044-8aed-d036b6dff9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11f63d1c-12a6-4b27-8d60-28efc0dfdcbd', 'volume_name': 'volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1179437b-0b8c-4479-bc93-af60e919dbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1179437b-0b8c-4479-bc93-af60e919dbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9e2bd4-6a70-45e6-a126-7928aa999abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:44 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Volume 11f63d1c-12a6-4b27-8d60-28efc0dfdcbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd', 'volume_size': 1} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:44 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4.0dd7792d-14e7-486e-a26a-a38d34ba430b" returned: 0 in 0.265s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-0dd7792d-14e7-486e-a26a-a38d34ba430b" released by "_delete_snapshot" :: held 1.983s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-32726f1b-9dba-44e7-8dfb-6441dfe213a4" released by "delete_snapshot" :: held 2.007s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "cinder-quobyte-202ba92d-4f1b-41d4-a1e9-528602b30a25" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-202ba92d-4f1b-41d4-a1e9-528602b30a25" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "cinder-quobyte-db633a1e-cb9d-4e8d-907a-1ca0a3503074" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-db633a1e-cb9d-4e8d-907a-1ca0a3503074" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Deleting offline snapshot db633a1e-cb9d-4e8d-907a-1ca0a3503074 of volume 202ba92d-4f1b-41d4-a1e9-528602b30a25 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] snapshot_file for this snap is: volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5eeb98-6cac-46f3-bc1e-9abd7438efe8]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:44 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628 1G" returned: 0 in 0.510s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40172c5-6d45-4528-b468-ca65f5f795a3 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:44 devstack sudo[92514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074 Sep 23 12:38:44 devstack sudo[92514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:44 devstack sudo[92515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40172c5-6d45-4528-b468-ca65f5f795a3 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628 Sep 23 12:38:44 devstack sudo[92515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:44 devstack sudo[92514]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074" returned: 0 in 0.382s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-202ba92d-4f1b-41d4-a1e9-528602b30a25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[399c16ac-0108-48e6-97d6-11673177a23b]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:44 devstack sudo[92515]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40172c5-6d45-4528-b468-ca65f5f795a3 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628" returned: 0 in 0.333s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:44 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 12:38:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:44 devstack sudo[92526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628 Sep 23 12:38:44 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:44 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25 Sep 23 12:38:44 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:45 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628" returned: 0 in 0.260s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:45 devstack sudo[92531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.info Sep 23 12:38:45 devstack sudo[92531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:45 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25" returned: 0 in 0.392s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:45 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074 Sep 23 12:38:45 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:45 devstack sudo[92531]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.info" returned: 0 in 0.287s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:45 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:45 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.info Sep 23 12:38:45 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:45 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074" returned: 0 in 0.356s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:45 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074 Sep 23 12:38:45 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:45 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.info" returned: 0 in 0.276s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.286s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.480s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-183549098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f63d1c-12a6-4b27-8d60-28efc0dfdcbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dfc1082f7874d499d1d2cf815143200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:44Z,use_quota=True,user_id='c4c7b4020551450d9c0f58893335e270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Creating volume 11f63d1c-12a6-4b27-8d60-28efc0dfdcbd {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:38:45 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:45 devstack sudo[92547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd 1073741824 Sep 23 12:38:45 devstack sudo[92547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:45 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-99791994-fc94-41a7-850e-de199b3b7929 tempest-GroupSnapshotsV319Test-1025807562 None] group_snapshot 59e032e9-7e05-4e9d-a922-6f6461ce5b52: created successfully Sep 23 12:38:45 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25.db633a1e-cb9d-4e8d-907a-1ca0a3503074" returned: 0 in 0.278s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-db633a1e-cb9d-4e8d-907a-1ca0a3503074" released by "_delete_snapshot" :: held 1.517s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-202ba92d-4f1b-41d4-a1e9-528602b30a25" released by "delete_snapshot" :: held 1.550s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:45 devstack cinder-volume[86085]: WARNING cinder.quota [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1557657220 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1557657220, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:38:45 devstack cinder-volume[86085]: WARNING cinder.quota [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1557657220 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1557657220, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:38:45 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Created reservations ['7d72d7b0-3555-4d65-9401-fab9c4a5dcf3', '5055cf59-f00d-4bac-aea4-d8d64c8f4f33', 'b782c87e-2c8e-4adb-b5b9-2d3d3161b6fa', '408eabf2-88bf-4f3c-ab9e-a79048861aca'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:38:46 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] Created reservations ['ec810379-810e-41a0-9050-082662f10d12', '130a7ebd-4e20-481d-9d1f-25847c69d653', '60df5962-9625-4f40-bb2a-3016ad92ec77', '2089868f-cd53-40fe-bc58-fe20bf886a7a'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:38:46 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0996f022-8a2d-4585-aaeb-e2615c84ffee tempest-GroupSnapshotsTest-1165375712 None] group_snapshot e73f6623-56b6-4530-b6b0-86da4a2f91ce: deleted successfully Sep 23 12:38:46 devstack sudo[92547]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd 1073741824" returned: 0 in 0.511s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:46 devstack sudo[92554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd Sep 23 12:38:46 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:46 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd" returned: 0 in 0.270s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:46 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:38:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9e2bd4-6a70-45e6-a126-7928aa999abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028ed537-3e7f-448e-aa17-ee1f99325a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:46 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Volume volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd (11f63d1c-12a6-4b27-8d60-28efc0dfdcbd): created successfully Sep 23 12:38:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028ed537-3e7f-448e-aa17-ee1f99325a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Flow 'volume_create_manager' (d3dfb36c-df92-4dd5-b3bc-f4ba6e32a303) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:38:46 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ab7c56ab-0089-4e7a-bebc-05946d0ce881 tempest-VolumesCloneTest-803817801 None] Created volume successfully. Sep 23 12:38:46 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] group_snapshot 59e032e9-7e05-4e9d-a922-6f6461ce5b52: deleting Sep 23 12:38:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] group_snapshot 59e032e9-7e05-4e9d-a922-6f6461ce5b52: deleting {{(pid=86085) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 12:38:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] Acquiring lock "cinder-quobyte-b40172c5-6d45-4528-b468-ca65f5f795a3" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] Lock "cinder-quobyte-b40172c5-6d45-4528-b468-ca65f5f795a3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] Acquiring lock "cinder-quobyte-288b53c8-1fc0-41c4-931b-c8c4aa4a3628" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] Lock "cinder-quobyte-288b53c8-1fc0-41c4-931b-c8c4aa4a3628" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] Deleting offline snapshot 288b53c8-1fc0-41c4-931b-c8c4aa4a3628 of volume b40172c5-6d45-4528-b468-ca65f5f795a3 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] snapshot_file for this snap is: volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b7e8a3-049a-41d9-8c21-712a60d19f2e]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:47 devstack sudo[92557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628 Sep 23 12:38:47 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "cinder-quobyte-202ba92d-4f1b-41d4-a1e9-528602b30a25" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-202ba92d-4f1b-41d4-a1e9-528602b30a25" acquired by "delete_volume" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[173069e3-96f1-47c3-9c51-194a0996043d]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:47 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628" returned: 0 in 0.422s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b40172c5-6d45-4528-b468-ca65f5f795a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:38:47 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25 Sep 23 12:38:47 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d16766a-3489-413b-a546-e30caf5aa913]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:47 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3 Sep 23 12:38:47 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:47 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25" returned: 0 in 0.439s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:38:47 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25 Sep 23 12:38:47 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Flow 'volume_create_manager' (0e306900-2dfb-4164-b76c-7990a4097b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d605687b-53f5-42bf-b0d4-c7945e231e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d605687b-53f5-42bf-b0d4-c7945e231e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1696592075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c07fcc2-2d2b-4864-8342-64de5a11405c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dfc1082f7874d499d1d2cf815143200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=11f63d1c-12a6-4b27-8d60-28efc0dfdcbd,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:48Z,use_quota=True,user_id='c4c7b4020551450d9c0f58893335e270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eca53e5-3b79-45ab-b712-0dab6dab9115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eca53e5-3b79-45ab-b712-0dab6dab9115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621ea729-0fa3-4659-9f07-48cadf241720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621ea729-0fa3-4659-9f07-48cadf241720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5c07fcc2-2d2b-4864-8342-64de5a11405c', 'volume_name': 'volume-5c07fcc2-2d2b-4864-8342-64de5a11405c', 'volume_size': 2, 'source_volid': '11f63d1c-12a6-4b27-8d60-28efc0dfdcbd', 'source_volstatus': 'available'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:47 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf9fb7d-e50b-4b54-97be-6c1547cafa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf9fb7d-e50b-4b54-97be-6c1547cafa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734b6c4b-5a96-4cfb-a584-108470188bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:47 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Volume 5c07fcc2-2d2b-4864-8342-64de5a11405c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5c07fcc2-2d2b-4864-8342-64de5a11405c', 'volume_size': 2, 'source_volid': '11f63d1c-12a6-4b27-8d60-28efc0dfdcbd', 'source_volstatus': 'available'} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3" returned: 0 in 0.425s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:47 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Cloning volume 11f63d1c-12a6-4b27-8d60-28efc0dfdcbd to volume 5c07fcc2-2d2b-4864-8342-64de5a11405c Sep 23 12:38:47 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628 Sep 23 12:38:47 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Creating offline snapshot 604a999d-92a9-4d2f-90b0-842fa903f59a of volume 11f63d1c-12a6-4b27-8d60-28efc0dfdcbd {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[aceb0534-038f-4715-a25a-04a59cdf4914]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:48 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-202ba92d-4f1b-41d4-a1e9-528602b30a25" returned: 0 in 0.268s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-202ba92d-4f1b-41d4-a1e9-528602b30a25" released by "delete_volume" :: held 0.776s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "cinder-quobyte-32726f1b-9dba-44e7-8dfb-6441dfe213a4" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-32726f1b-9dba-44e7-8dfb-6441dfe213a4" acquired by "delete_volume" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f605fc-35fd-4a9c-8322-02972a61e428]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:48 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd Sep 23 12:38:48 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:48 devstack sudo[92578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4 Sep 23 12:38:48 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:48 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628" returned: 0 in 0.378s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:48 devstack sudo[92584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628 Sep 23 12:38:48 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:48 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd" returned: 0 in 0.428s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:48 devstack sudo[92589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a 1G Sep 23 12:38:48 devstack sudo[92589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:48 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4" returned: 0 in 0.478s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:48 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3.288b53c8-1fc0-41c4-931b-c8c4aa4a3628" returned: 0 in 0.326s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:48 devstack sudo[92595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4 Sep 23 12:38:48 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] Lock "cinder-quobyte-288b53c8-1fc0-41c4-931b-c8c4aa4a3628" released by "_delete_snapshot" :: held 1.701s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] Lock "cinder-quobyte-b40172c5-6d45-4528-b468-ca65f5f795a3" released by "delete_snapshot" :: held 1.721s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:48 devstack cinder-volume[86085]: WARNING cinder.quota [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1881997447 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1881997447, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:38:48 devstack cinder-volume[86085]: WARNING cinder.quota [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1881997447 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1881997447, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] Created reservations ['3a0ca000-ff8e-4698-8fee-c31adc603fae', '1251aa9d-c8cd-4b7a-b4bb-de7e97f67d57', 'c2bd282f-0030-445e-acca-634a0acbefb1', '76213d37-f641-4357-9be7-14f7722c114b'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:38:48 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-36af4399-c392-456b-ab48-3aa809bfb180 tempest-GroupSnapshotsV319Test-1025807562 None] group_snapshot 59e032e9-7e05-4e9d-a922-6f6461ce5b52: deleted successfully Sep 23 12:38:48 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-32726f1b-9dba-44e7-8dfb-6441dfe213a4" returned: 0 in 0.313s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-32726f1b-9dba-44e7-8dfb-6441dfe213a4" released by "delete_volume" :: held 0.851s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:48 devstack sudo[92589]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a 1G" returned: 0 in 0.504s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:49 devstack sudo[92602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a Sep 23 12:38:49 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:49 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Created reservations ['14fb7c39-5822-40be-b40d-09e195b600f9'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:38:49 devstack cinder-volume[86085]: WARNING cinder.quota [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1557657220 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1557657220, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:38:49 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Created reservations ['8aef33d6-7074-4ba0-933f-26e97d592bf7', '80ed6bb2-9131-4cd8-919f-fffb2c6a1f49', 'bbca20ab-190f-4d50-b498-869d46f79e58', '90b9bda3-9785-4210-8e4c-50e8001648ce'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:38:49 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Created reservations ['df7c65c2-5f15-4999-b404-ea5aabc92487', '6fa2496d-9b87-4213-aeed-67a9f6b89260', '6e2dd72e-b5fb-4f2c-92e1-f472acbd1c88', 'e05f8899-98ce-4005-a302-86fa32769d50'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:38:49 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a" returned: 0 in 0.342s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:49 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a is being set with open permissions: ugo+rw Sep 23 12:38:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:38:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:38:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:49 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a Sep 23 12:38:49 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:49 devstack sudo[92610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:38:49 devstack sudo[92610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:49 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d4a782e1-e262-472b-9357-4e1e2c440033 tempest-GroupSnapshotsV319Test-1025807562 None] Acquiring lock "cinder-quobyte-b40172c5-6d45-4528-b468-ca65f5f795a3" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:49 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d4a782e1-e262-472b-9357-4e1e2c440033 tempest-GroupSnapshotsV319Test-1025807562 None] Lock "cinder-quobyte-b40172c5-6d45-4528-b468-ca65f5f795a3" acquired by "delete_volume" :: waited 0.038s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:49 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a" returned: 0 in 0.355s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:49 devstack sudo[92610]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:49 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c393d885-9afd-41ae-b04e-d9a66ad10081]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d4a782e1-e262-472b-9357-4e1e2c440033 tempest-GroupSnapshotsV319Test-1025807562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.366s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:49 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:38:49 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-3926c08c-9fe9-4e71-85f6-e9d4f36b3bf6 tempest-GroupSnapshotsTest-1165375712 None] Delete group completed successfully. Sep 23 12:38:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:49 devstack sudo[92616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.info Sep 23 12:38:49 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:49 devstack sudo[92615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3 Sep 23 12:38:49 devstack sudo[92615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:50 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.info" returned: 0 in 0.296s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:50 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.info is being set with open permissions: ugo+rw Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:50 devstack sudo[92621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.info Sep 23 12:38:50 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:50 devstack sudo[92615]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d4a782e1-e262-472b-9357-4e1e2c440033 tempest-GroupSnapshotsV319Test-1025807562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3" returned: 0 in 0.463s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d4a782e1-e262-472b-9357-4e1e2c440033 tempest-GroupSnapshotsV319Test-1025807562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:50 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3 Sep 23 12:38:50 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:50 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-b12b6158-e2ff-4f98-89c3-ce7d655eadf4 tempest-GroupSnapshotsTest-1165375712 None] Group tempest-GroupSnapshotsTest-Group-1918454150: creating Sep 23 12:38:50 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-b12b6158-e2ff-4f98-89c3-ce7d655eadf4 tempest-GroupSnapshotsTest-1165375712 None] Group tempest-GroupSnapshotsTest-Group-1918454150: created successfully Sep 23 12:38:50 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-b12b6158-e2ff-4f98-89c3-ce7d655eadf4 tempest-GroupSnapshotsTest-1165375712 None] Create group completed successfully. Sep 23 12:38:50 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.info" returned: 0 in 0.311s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Acquiring lock "cinder-quobyte-5c07fcc2-2d2b-4864-8342-64de5a11405c" by "_copy_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Lock "cinder-quobyte-5c07fcc2-2d2b-4864-8342-64de5a11405c" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] snapshot: 604a999d-92a9-4d2f-90b0-842fa903f59a, volume: 5c07fcc2-2d2b-4864-8342-64de5a11405c, {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ef6bd8-7e9e-47da-9425-98a6acfcfd4c]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:50 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d4a782e1-e262-472b-9357-4e1e2c440033 tempest-GroupSnapshotsV319Test-1025807562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b40172c5-6d45-4528-b468-ca65f5f795a3" returned: 0 in 0.304s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d4a782e1-e262-472b-9357-4e1e2c440033 tempest-GroupSnapshotsV319Test-1025807562 None] Lock "cinder-quobyte-b40172c5-6d45-4528-b468-ca65f5f795a3" released by "delete_volume" :: held 0.879s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:50 devstack sudo[92630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a Sep 23 12:38:50 devstack sudo[92630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-d4a782e1-e262-472b-9357-4e1e2c440033 tempest-GroupSnapshotsV319Test-1025807562 None] Created reservations ['0c757f7e-abd2-4835-932f-97b68cd9e7f4'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:38:50 devstack cinder-volume[86085]: WARNING cinder.quota [None req-d4a782e1-e262-472b-9357-4e1e2c440033 tempest-GroupSnapshotsV319Test-1025807562 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1881997447 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1881997447, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-d4a782e1-e262-472b-9357-4e1e2c440033 tempest-GroupSnapshotsV319Test-1025807562 None] Created reservations ['3e44fc99-c6fd-47b2-a22b-c4591d209958', '68e56e68-3373-4dc4-a088-5225e582a9de', '4e5d7cf7-fb0a-4146-9232-29a201258a0b', 'be9bfdbd-4f3c-4e07-8b05-ed9e54fb885b'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d4a782e1-e262-472b-9357-4e1e2c440033 tempest-GroupSnapshotsV319Test-1025807562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d4a782e1-e262-472b-9357-4e1e2c440033 tempest-GroupSnapshotsV319Test-1025807562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d4a782e1-e262-472b-9357-4e1e2c440033 tempest-GroupSnapshotsV319Test-1025807562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d4a782e1-e262-472b-9357-4e1e2c440033 tempest-GroupSnapshotsV319Test-1025807562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d4a782e1-e262-472b-9357-4e1e2c440033 tempest-GroupSnapshotsV319Test-1025807562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:38:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d4a782e1-e262-472b-9357-4e1e2c440033 tempest-GroupSnapshotsV319Test-1025807562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:50 devstack sudo[92632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:38:50 devstack sudo[92632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:50 devstack sudo[92630]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a" returned: 0 in 0.543s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:38:51 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c86097-1af1-4fd4-89e0-423683b8c3e3]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:51 devstack sudo[92632]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d4a782e1-e262-472b-9357-4e1e2c440033 tempest-GroupSnapshotsV319Test-1025807562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.363s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:51 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-d4a782e1-e262-472b-9357-4e1e2c440033 tempest-GroupSnapshotsV319Test-1025807562 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:38:51 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d4a782e1-e262-472b-9357-4e1e2c440033 tempest-GroupSnapshotsV319Test-1025807562 None] Delete group completed successfully. Sep 23 12:38:51 devstack sudo[92637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd Sep 23 12:38:51 devstack sudo[92637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:51 devstack sudo[92637]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd" returned: 0 in 0.463s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] will copy from snapshot at /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 12:38:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Creating direct copy from snapshot {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 12:38:51 devstack cinder-volume[86085]: DEBUG cinder.utils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Path /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5c07fcc2-2d2b-4864-8342-64de5a11405c not found in is_blk_device check {{(pid=86085) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 12:38:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5c07fcc2-2d2b-4864-8342-64de5a11405c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:51 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5c07fcc2-2d2b-4864-8342-64de5a11405c Sep 23 12:38:51 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:52 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:38:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Flow 'volume_create_manager' (66e19dee-fe91-4b95-9f90-29f9c6cf2079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:38:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3c2149-79b0-4ec3-a8f1-fc21d40d63fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3c2149-79b0-4ec3-a8f1-fc21d40d63fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-520531829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6dd610d5-742e-4c06-85d3-ae8a59ab5939,host='devstack@QuobyteHD#QuobyteHD',id=e955234c-87ad-4eca-bf87-b96f79b641bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9168358ddb434985934015f1d67af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:52Z,use_quota=True,user_id='c16b8034c7414f49af59e7bbcf30c0aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bec4417f-29ca-4c4f-b46d-9df930897ab3),volume_type_id=bec4417f-29ca-4c4f-b46d-9df930897ab3)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edcd8174-f73e-412f-ab95-6143a5eb082a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edcd8174-f73e-412f-ab95-6143a5eb082a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28123e1-70a3-4c17-9266-c75053a01670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28123e1-70a3-4c17-9266-c75053a01670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e955234c-87ad-4eca-bf87-b96f79b641bf', 'volume_name': 'volume-e955234c-87ad-4eca-bf87-b96f79b641bf', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f818a7d5-a626-4024-8d8d-31d1142de384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f818a7d5-a626-4024-8d8d-31d1142de384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fcba545-cb10-4c07-be4d-f85420714190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:52 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Volume e955234c-87ad-4eca-bf87-b96f79b641bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e955234c-87ad-4eca-bf87-b96f79b641bf', 'volume_size': 1} Sep 23 12:38:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:56 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:38:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Flow 'volume_create_manager' (5287ce91-caa9-4c53-b501-8894a2422466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:38:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a3ce64-e678-4094-862b-bae9489d03ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a3ce64-e678-4094-862b-bae9489d03ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-538565932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ab305a-df68-4d6c-9ccb-103a3eeb6899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a45a4895933f40f08b7ce0eb33e61560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:56Z,use_quota=True,user_id='f43ac7df92c44ebfa0fb9799e624d6b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70bb5f23-9f04-42ca-84ac-29c4c8ad789a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70bb5f23-9f04-42ca-84ac-29c4c8ad789a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5aa0ed-538b-4793-862f-2dbc841d34c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5aa0ed-538b-4793-862f-2dbc841d34c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8ab305a-df68-4d6c-9ccb-103a3eeb6899', 'volume_name': 'volume-e8ab305a-df68-4d6c-9ccb-103a3eeb6899', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0ba84c-0966-4348-8140-310c60e4feb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0ba84c-0966-4348-8140-310c60e4feb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:38:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aedefcb1-f1f5-4214-b793-4f70d4bda485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:38:56 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Volume e8ab305a-df68-4d6c-9ccb-103a3eeb6899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8ab305a-df68-4d6c-9ccb-103a3eeb6899', 'volume_size': 1} Sep 23 12:38:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:38:59 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5c07fcc2-2d2b-4864-8342-64de5a11405c" returned: 0 in 8.130s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:59 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Image conversion details: src /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd, size 1024.00 MB, duration 8.13 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5c07fcc2-2d2b-4864-8342-64de5a11405c {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:38:59 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Converted 1024.00 MB image at 125.94 MB/s Sep 23 12:38:59 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5c07fcc2-2d2b-4864-8342-64de5a11405c is being set with open permissions: ugo+rw Sep 23 12:38:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5c07fcc2-2d2b-4864-8342-64de5a11405c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:38:59 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5c07fcc2-2d2b-4864-8342-64de5a11405c Sep 23 12:38:59 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:38:59 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Sep 23 12:38:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5c07fcc2-2d2b-4864-8342-64de5a11405c" returned: 0 in 0.251s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:38:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Lock "cinder-quobyte-5c07fcc2-2d2b-4864-8342-64de5a11405c" released by "_copy_volume_from_snapshot" :: held 9.480s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:38:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Acquiring lock "cinder-quobyte-604a999d-92a9-4d2f-90b0-842fa903f59a" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:38:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Lock "cinder-quobyte-604a999d-92a9-4d2f-90b0-842fa903f59a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:38:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Deleting offline snapshot 604a999d-92a9-4d2f-90b0-842fa903f59a of volume 11f63d1c-12a6-4b27-8d60-28efc0dfdcbd {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:38:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] snapshot_file for this snap is: volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:38:59 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8fbf78-7e5e-4ed4-ae54-cfb8135ac613]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:38:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:00 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a Sep 23 12:39:00 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:00 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a" returned: 0 in 0.393s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:39:00 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d572ee-62b0-47f8-8498-a86e4b364a39]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:00 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd Sep 23 12:39:00 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:00 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-9151780f-0475-48af-9ae3-b2be1e205aee tempest-GroupsTest-270916484 None] Group tempest-Group1-1626726126: creating Sep 23 12:39:00 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-9151780f-0475-48af-9ae3-b2be1e205aee tempest-GroupsTest-270916484 None] Group tempest-Group1-1626726126: created successfully Sep 23 12:39:00 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-9151780f-0475-48af-9ae3-b2be1e205aee tempest-GroupsTest-270916484 None] Create group completed successfully. Sep 23 12:39:00 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd" returned: 0 in 0.521s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:00 devstack sudo[92676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a Sep 23 12:39:00 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:01 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a" returned: 0 in 0.327s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:01 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a Sep 23 12:39:01 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:01 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd.604a999d-92a9-4d2f-90b0-842fa903f59a" returned: 0 in 0.256s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Lock "cinder-quobyte-604a999d-92a9-4d2f-90b0-842fa903f59a" released by "_delete_snapshot" :: held 1.606s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.576s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.322s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6dd610d5-742e-4c06-85d3-ae8a59ab5939,created_at=2026-09-23T10:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-520531829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6dd610d5-742e-4c06-85d3-ae8a59ab5939,host='devstack@QuobyteHD#QuobyteHD',id=e955234c-87ad-4eca-bf87-b96f79b641bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9168358ddb434985934015f1d67af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:52Z,use_quota=True,user_id='c16b8034c7414f49af59e7bbcf30c0aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bec4417f-29ca-4c4f-b46d-9df930897ab3),volume_type_id=bec4417f-29ca-4c4f-b46d-9df930897ab3)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:39:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Creating volume e955234c-87ad-4eca-bf87-b96f79b641bf {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:39:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:39:01 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:39:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734b6c4b-5a96-4cfb-a584-108470188bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c07fcc2-2d2b-4864-8342-64de5a11405c', 'volume_size': 2, 'source_volid': '11f63d1c-12a6-4b27-8d60-28efc0dfdcbd', 'source_volstatus': 'available'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:01 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf 1073741824 Sep 23 12:39:01 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9807ad9-a95d-4abd-9d02-6496774fbc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:01 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Volume volume-5c07fcc2-2d2b-4864-8342-64de5a11405c (5c07fcc2-2d2b-4864-8342-64de5a11405c): created successfully Sep 23 12:39:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9807ad9-a95d-4abd-9d02-6496774fbc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Flow 'volume_create_manager' (0e306900-2dfb-4164-b76c-7990a4097b1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:01 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-944d4d61-4830-4c98-95e8-44f803bae10c tempest-VolumesCloneTest-803817801 None] Created volume successfully. Sep 23 12:39:01 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-19d26653-68bc-43ad-8046-be6ef07f05eb tempest-GroupsTest-270916484 None] Group tempest-Group2-1741631309: creating Sep 23 12:39:01 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-19d26653-68bc-43ad-8046-be6ef07f05eb tempest-GroupsTest-270916484 None] Group tempest-Group2-1741631309: created successfully Sep 23 12:39:01 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-19d26653-68bc-43ad-8046-be6ef07f05eb tempest-GroupsTest-270916484 None] Create group completed successfully. Sep 23 12:39:02 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf 1073741824" returned: 0 in 0.473s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:02 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf Sep 23 12:39:02 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:02 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf" returned: 0 in 0.256s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.989s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-538565932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ab305a-df68-4d6c-9ccb-103a3eeb6899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a45a4895933f40f08b7ce0eb33e61560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:38:56Z,use_quota=True,user_id='f43ac7df92c44ebfa0fb9799e624d6b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Creating volume e8ab305a-df68-4d6c-9ccb-103a3eeb6899 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:39:02 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e8ab305a-df68-4d6c-9ccb-103a3eeb6899 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fcba545-cb10-4c07-be4d-f85420714190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e955234c-87ad-4eca-bf87-b96f79b641bf', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6790ab0f-aee3-40e7-94be-6e5c3e6370af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:02 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e8ab305a-df68-4d6c-9ccb-103a3eeb6899 1073741824 Sep 23 12:39:02 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] Acquiring lock "cinder-5c07fcc2-2d2b-4864-8342-64de5a11405c-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] Lock "cinder-5c07fcc2-2d2b-4864-8342-64de5a11405c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:02 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Volume volume-e955234c-87ad-4eca-bf87-b96f79b641bf (e955234c-87ad-4eca-bf87-b96f79b641bf): created successfully Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6790ab0f-aee3-40e7-94be-6e5c3e6370af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Flow 'volume_create_manager' (66e19dee-fe91-4b95-9f90-29f9c6cf2079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:02 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-19b6e31a-c10c-4613-b2bd-2669c5aebbea tempest-GroupSnapshotsTest-1165375712 None] Created volume successfully. Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] Acquiring lock "cinder-quobyte-5c07fcc2-2d2b-4864-8342-64de5a11405c" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] Lock "cinder-quobyte-5c07fcc2-2d2b-4864-8342-64de5a11405c" acquired by "delete_volume" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[338fe933-34bd-42b2-b571-b5033e92e779]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5c07fcc2-2d2b-4864-8342-64de5a11405c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:02 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5c07fcc2-2d2b-4864-8342-64de5a11405c Sep 23 12:39:02 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:02 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e8ab305a-df68-4d6c-9ccb-103a3eeb6899 1073741824" returned: 0 in 0.466s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e8ab305a-df68-4d6c-9ccb-103a3eeb6899 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:02 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e8ab305a-df68-4d6c-9ccb-103a3eeb6899 Sep 23 12:39:02 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:02 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5c07fcc2-2d2b-4864-8342-64de5a11405c" returned: 0 in 0.427s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5c07fcc2-2d2b-4864-8342-64de5a11405c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:02 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5c07fcc2-2d2b-4864-8342-64de5a11405c Sep 23 12:39:03 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:03 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e8ab305a-df68-4d6c-9ccb-103a3eeb6899" returned: 0 in 0.280s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aedefcb1-f1f5-4214-b793-4f70d4bda485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8ab305a-df68-4d6c-9ccb-103a3eeb6899', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8007f064-b6ca-4d10-8f51-cbbe5cdb3157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:03 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Volume volume-e8ab305a-df68-4d6c-9ccb-103a3eeb6899 (e8ab305a-df68-4d6c-9ccb-103a3eeb6899): created successfully Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8007f064-b6ca-4d10-8f51-cbbe5cdb3157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Flow 'volume_create_manager' (5287ce91-caa9-4c53-b501-8894a2422466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:03 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-127dffa1-800e-4d83-833c-379121ab851c tempest-AttachVolumeTestJSON-539427221 None] Created volume successfully. Sep 23 12:39:03 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5c07fcc2-2d2b-4864-8342-64de5a11405c" returned: 0 in 0.279s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] Lock "cinder-quobyte-5c07fcc2-2d2b-4864-8342-64de5a11405c" released by "delete_volume" :: held 0.770s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] Created reservations ['480d5d0d-65a6-45c4-b9cf-ff040fabab9c', '9c150eea-c90d-4734-8081-dfe42f7c059b', 'aac954d6-01d2-4bfa-bfca-325dd27e2556', '4daf0d6f-7020-42b0-9d03-125cf1042d7a'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:03 devstack sudo[92709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:39:03 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Flow 'volume_create_manager' (484321ec-4c68-4c74-bd33-285c40c4dadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bcfd636-9c5b-43df-b3aa-c2d41a32aaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:03 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] GroupSnapshot 6ce0888a-9069-4625-b084-c671e0301f4d: creating. Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bcfd636-9c5b-43df-b3aa-c2d41a32aaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1622257102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2273c493-0945-4182-82ba-87cfac979c46,host='devstack@QuobyteHD#QuobyteHD',id=df8b2ef5-764c-4d09-9559-8bb8c7f04f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267a5a4b688b4d13b24c2c5fdc32741d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:39:04Z,use_quota=True,user_id='8255a84c95fb4f8c817418a6ab164469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3493cafb-01d0-46df-b672-963a792b9224),volume_type_id=3493cafb-01d0-46df-b672-963a792b9224)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29c6911-0587-49c2-8324-10f8a589a378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29c6911-0587-49c2-8324-10f8a589a378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7206c0-5252-4688-b153-8fbd34e0a4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7206c0-5252-4688-b153-8fbd34e0a4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df8b2ef5-764c-4d09-9559-8bb8c7f04f49', 'volume_name': 'volume-df8b2ef5-764c-4d09-9559-8bb8c7f04f49', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc45de8e-a558-4f04-bd8c-0fb9f2a3518f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc45de8e-a558-4f04-bd8c-0fb9f2a3518f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:03 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee360a9-1e1e-4aa1-a182-043aa4aaa764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:03 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Volume df8b2ef5-764c-4d09-9559-8bb8c7f04f49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df8b2ef5-764c-4d09-9559-8bb8c7f04f49', 'volume_size': 1} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2273c493-0945-4182-82ba-87cfac979c46,created_at=2026-09-23T10:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1622257102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2273c493-0945-4182-82ba-87cfac979c46,host='devstack@QuobyteHD#QuobyteHD',id=df8b2ef5-764c-4d09-9559-8bb8c7f04f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267a5a4b688b4d13b24c2c5fdc32741d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:39:04Z,use_quota=True,user_id='8255a84c95fb4f8c817418a6ab164469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3493cafb-01d0-46df-b672-963a792b9224),volume_type_id=3493cafb-01d0-46df-b672-963a792b9224)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Creating volume df8b2ef5-764c-4d09-9559-8bb8c7f04f49 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:39:03 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-df8b2ef5-764c-4d09-9559-8bb8c7f04f49 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.491s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:39:03 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-df8b2ef5-764c-4d09-9559-8bb8c7f04f49 1073741824 Sep 23 12:39:03 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] Acquiring lock "cinder-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:03 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] Deleted volume successfully. Sep 23 12:39:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] Group snapshot 6ce0888a-9069-4625-b084-c671e0301f4d: creating. {{(pid=86085) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] Lock "cinder-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fb7261f6-cdc5-4c2b-b073-f6f3c808fbb6 tempest-VolumesCloneTest-803817801 None] Lock "cinder-5c07fcc2-2d2b-4864-8342-64de5a11405c-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] Acquiring lock "cinder-quobyte-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] Lock "cinder-quobyte-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd" acquired by "delete_volume" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b69445-de06-4a79-a889-530b8a42a71f]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:04 devstack sudo[92718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd Sep 23 12:39:04 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:04 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-df8b2ef5-764c-4d09-9559-8bb8c7f04f49 1073741824" returned: 0 in 0.629s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-df8b2ef5-764c-4d09-9559-8bb8c7f04f49 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:04 devstack sudo[92736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-df8b2ef5-764c-4d09-9559-8bb8c7f04f49 Sep 23 12:39:04 devstack sudo[92736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:04 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd" returned: 0 in 0.493s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-3e1adcd8-5980-44db-95ad-2c24235af7a9 req-fa3769d5-ec4e-417c-a9a7-de752f3de012 tempest-AttachVolumeTestJSON-539427221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:04 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd Sep 23 12:39:04 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:04 devstack sudo[92736]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-df8b2ef5-764c-4d09-9559-8bb8c7f04f49" returned: 0 in 0.259s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.836s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee360a9-1e1e-4aa1-a182-043aa4aaa764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df8b2ef5-764c-4d09-9559-8bb8c7f04f49', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3463d1c8-4a6b-4783-9c92-6687cd2ee194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] Creating offline snapshot 3d00a942-f754-4f34-a52f-5580eff51e1a of volume e955234c-87ad-4eca-bf87-b96f79b641bf {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:39:04 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Volume volume-df8b2ef5-764c-4d09-9559-8bb8c7f04f49 (df8b2ef5-764c-4d09-9559-8bb8c7f04f49): created successfully Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3463d1c8-4a6b-4783-9c92-6687cd2ee194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:04 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Flow 'volume_create_manager' (484321ec-4c68-4c74-bd33-285c40c4dadf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea84aa2c-73c7-4251-bf7c-8609c58f4044]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd" returned: 0 in 0.281s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] Lock "cinder-quobyte-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd" released by "delete_volume" :: held 0.872s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:04 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-a30c454e-f04c-4986-ab7a-987f122f1997 tempest-GroupsTest-270916484 None] Created volume successfully. Sep 23 12:39:05 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] Created reservations ['4dee6c2c-ecb5-4e91-81e0-2ea0d843ca14', '6edbfeb3-aeb9-4d72-a2c3-3e363aa49038', 'a4bf4003-dd3c-407e-bcb1-529afc368427', '99f1bbbf-dc68-453d-81a0-863660e81502'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:39:05 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf Sep 23 12:39:05 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:05 devstack sudo[92744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:39:05 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:05 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf" returned: 0 in 0.431s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:05 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.267s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:05 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:39:05 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a 1G Sep 23 12:39:05 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:05 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] Deleted volume successfully. Sep 23 12:39:05 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-eb6629b5-7548-4355-b012-3339456793d5 tempest-VolumesCloneTest-803817801 None] Lock "cinder-11f63d1c-12a6-4b27-8d60-28efc0dfdcbd-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:05 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a 1G" returned: 0 in 0.440s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e955234c-87ad-4eca-bf87-b96f79b641bf -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:05 devstack sudo[92757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e955234c-87ad-4eca-bf87-b96f79b641bf -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a Sep 23 12:39:05 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:06 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e955234c-87ad-4eca-bf87-b96f79b641bf -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a" returned: 0 in 0.338s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:06 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a is being set with open permissions: ugo+rw: NotImplementedError Sep 23 12:39:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:06 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a Sep 23 12:39:06 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:06 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a" returned: 0 in 0.270s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:06 devstack sudo[92765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.info Sep 23 12:39:06 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:06 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.info" returned: 0 in 0.332s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:06 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 12:39:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:06 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.info Sep 23 12:39:06 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:06 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] Acquiring lock "cinder-quobyte-df8b2ef5-764c-4d09-9559-8bb8c7f04f49" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:06 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] Lock "cinder-quobyte-df8b2ef5-764c-4d09-9559-8bb8c7f04f49" acquired by "delete_volume" :: waited 0.023s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:06 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[975386ca-7cbe-46fc-b9ee-430081f7776a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-df8b2ef5-764c-4d09-9559-8bb8c7f04f49 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:07 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.info" returned: 0 in 0.314s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.245s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-3e1adcd8-5980-44db-95ad-2c24235af7a9 req-fa3769d5-ec4e-417c-a9a7-de752f3de012 tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.424s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:07 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-df8b2ef5-764c-4d09-9559-8bb8c7f04f49 Sep 23 12:39:07 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-3e1adcd8-5980-44db-95ad-2c24235af7a9 req-fa3769d5-ec4e-417c-a9a7-de752f3de012 tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-3e1adcd8-5980-44db-95ad-2c24235af7a9 req-fa3769d5-ec4e-417c-a9a7-de752f3de012 tempest-AttachVolumeTestJSON-539427221 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-e8ab305a-df68-4d6c-9ccb-103a3eeb6899', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfae2661-1247-4a54-982b-6d46ac1efa17', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:39:07 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-836aa523-4d83-40c7-993e-bee3c262ea97 tempest-GroupSnapshotsTest-1165375712 None] group_snapshot 6ce0888a-9069-4625-b084-c671e0301f4d: created successfully Sep 23 12:39:07 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-3e1adcd8-5980-44db-95ad-2c24235af7a9 req-fa3769d5-ec4e-417c-a9a7-de752f3de012 tempest-AttachVolumeTestJSON-539427221 None] attachment_update completed successfully. Sep 23 12:39:07 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:07 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] group_snapshot 6ce0888a-9069-4625-b084-c671e0301f4d: deleting Sep 23 12:39:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-df8b2ef5-764c-4d09-9559-8bb8c7f04f49" returned: 0 in 0.562s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-df8b2ef5-764c-4d09-9559-8bb8c7f04f49 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:07 devstack sudo[92852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-df8b2ef5-764c-4d09-9559-8bb8c7f04f49 Sep 23 12:39:07 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] group_snapshot 6ce0888a-9069-4625-b084-c671e0301f4d: deleting {{(pid=86085) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 12:39:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "cinder-quobyte-e955234c-87ad-4eca-bf87-b96f79b641bf" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-e955234c-87ad-4eca-bf87-b96f79b641bf" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "cinder-quobyte-3d00a942-f754-4f34-a52f-5580eff51e1a" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-3d00a942-f754-4f34-a52f-5580eff51e1a" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] Deleting offline snapshot 3d00a942-f754-4f34-a52f-5580eff51e1a of volume e955234c-87ad-4eca-bf87-b96f79b641bf {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:39:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] snapshot_file for this snap is: volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:39:07 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c3c4eb-e883-4515-8b60-d07d77567da2]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:07 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-df8b2ef5-764c-4d09-9559-8bb8c7f04f49" returned: 0 in 0.422s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] Lock "cinder-quobyte-df8b2ef5-764c-4d09-9559-8bb8c7f04f49" released by "delete_volume" :: held 1.045s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:07 devstack sudo[93190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a Sep 23 12:39:07 devstack sudo[93190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] Created reservations ['a1134381-d879-40ff-8119-7e17e0561093'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:39:08 devstack cinder-volume[86085]: WARNING cinder.quota [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1045451894 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1045451894, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:39:08 devstack cinder-volume[86085]: WARNING cinder.quota [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1045451894 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1045451894, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] Created reservations ['42759607-8d50-4e83-895b-d1f39c554c23', '099767ba-9289-47ec-bda7-d6d4febb0678', 'fb5dd534-6b6e-4a89-b198-25c3506d3b1b', 'cd7f208a-85a4-437a-bde4-c7b527e59aec'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:08 devstack sudo[93190]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a" returned: 0 in 0.514s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e955234c-87ad-4eca-bf87-b96f79b641bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:39:08 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:39:08 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[406f4a28-154e-44c2-9a02-c398f6c3bcd6]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:08 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf Sep 23 12:39:08 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-b8105d88-7420-410a-bb2e-90a7aa0e9b8e tempest-GroupsTest-270916484 None] Created reservations ['2aa4ed93-4f73-48fb-8d45-e27013b3576a'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b8105d88-7420-410a-bb2e-90a7aa0e9b8e tempest-GroupsTest-270916484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b8105d88-7420-410a-bb2e-90a7aa0e9b8e tempest-GroupsTest-270916484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b8105d88-7420-410a-bb2e-90a7aa0e9b8e tempest-GroupsTest-270916484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b8105d88-7420-410a-bb2e-90a7aa0e9b8e tempest-GroupsTest-270916484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b8105d88-7420-410a-bb2e-90a7aa0e9b8e tempest-GroupsTest-270916484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b8105d88-7420-410a-bb2e-90a7aa0e9b8e tempest-GroupsTest-270916484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:08 devstack sudo[93201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:39:08 devstack sudo[93201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:08 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.439s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:39:08 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-1f8e98be-368b-405f-88ea-99a64d9566d9 tempest-GroupsTest-270916484 None] Delete group completed successfully. Sep 23 12:39:08 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf" returned: 0 in 0.545s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:08 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a Sep 23 12:39:08 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:08 devstack sudo[93201]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b8105d88-7420-410a-bb2e-90a7aa0e9b8e tempest-GroupsTest-270916484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.340s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:08 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-b8105d88-7420-410a-bb2e-90a7aa0e9b8e tempest-GroupsTest-270916484 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:39:08 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-b8105d88-7420-410a-bb2e-90a7aa0e9b8e tempest-GroupsTest-270916484 None] Delete group completed successfully. Sep 23 12:39:09 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a" returned: 0 in 0.460s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:09 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a Sep 23 12:39:09 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:09 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf.3d00a942-f754-4f34-a52f-5580eff51e1a" returned: 0 in 0.367s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-3d00a942-f754-4f34-a52f-5580eff51e1a" released by "_delete_snapshot" :: held 2.067s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-e955234c-87ad-4eca-bf87-b96f79b641bf" released by "delete_snapshot" :: held 2.119s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:09 devstack cinder-volume[86085]: WARNING cinder.quota [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1194098858 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1194098858, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:39:09 devstack cinder-volume[86085]: WARNING cinder.quota [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1194098858 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1194098858, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:39:09 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] Created reservations ['809aa8d0-ecb4-4d69-901e-d1a162ce96ab', '8f51353b-9833-4933-a4c2-121a7d855c5c', 'afb5d7ac-bc97-430b-8e1d-5a9245df894b', 'c5a3d525-cd77-4d37-a375-f4b6199b30b4'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:39:09 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=195,cinder:INSERT=51,cinder:UPDATE=176,cinder:DELETE=7 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:UPDATE=219,cinder:SELECT=175,cinder:INSERT=42,cinder:DELETE=11 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Flow 'volume_create_manager' (9731cfa8-3a26-4d4a-b915-7ae35bcd3040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe0884d-a720-48f4-89e5-70452f1e8ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:10 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-b8bd1196-f9f4-4e7b-b74a-32c77d229420 tempest-GroupSnapshotsTest-1165375712 None] group_snapshot 6ce0888a-9069-4625-b084-c671e0301f4d: deleted successfully Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe0884d-a720-48f4-89e5-70452f1e8ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1342398775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7800273-273a-46c2-bfaa-373f31c3e983,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e8c2de354f043988a8148339ea01db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:39:10Z,use_quota=True,user_id='beb25e4908d34e15aa703a0eeadc6e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f534668-8dc3-4ef7-8df6-8290193a5810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f534668-8dc3-4ef7-8df6-8290193a5810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dce1649-89e1-48cb-8b91-bfd9ab29a9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dce1649-89e1-48cb-8b91-bfd9ab29a9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7800273-273a-46c2-bfaa-373f31c3e983', 'volume_name': 'volume-b7800273-273a-46c2-bfaa-373f31c3e983', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d98206-6de2-44d7-936b-dcfc95614a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d98206-6de2-44d7-936b-dcfc95614a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf81d24b-627d-48b3-8cca-d618d55cd0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:10 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Volume b7800273-273a-46c2-bfaa-373f31c3e983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7800273-273a-46c2-bfaa-373f31c3e983', 'volume_size': 1} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1342398775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7800273-273a-46c2-bfaa-373f31c3e983,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e8c2de354f043988a8148339ea01db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:39:10Z,use_quota=True,user_id='beb25e4908d34e15aa703a0eeadc6e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Creating volume b7800273-273a-46c2-bfaa-373f31c3e983 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:39:10 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7800273-273a-46c2-bfaa-373f31c3e983 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:10 devstack sudo[93223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7800273-273a-46c2-bfaa-373f31c3e983 1073741824 Sep 23 12:39:10 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:10 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-714bd454-ac97-43d7-bf9d-2dd0a3e04271 tempest-GroupsTest-270916484 None] Group tempest-GroupsTest-Group-463947959: creating Sep 23 12:39:10 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-714bd454-ac97-43d7-bf9d-2dd0a3e04271 tempest-GroupsTest-270916484 None] Group tempest-GroupsTest-Group-463947959: created successfully Sep 23 12:39:10 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-714bd454-ac97-43d7-bf9d-2dd0a3e04271 tempest-GroupsTest-270916484 None] Create group completed successfully. Sep 23 12:39:10 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7800273-273a-46c2-bfaa-373f31c3e983 1073741824" returned: 0 in 0.492s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7800273-273a-46c2-bfaa-373f31c3e983 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:10 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7800273-273a-46c2-bfaa-373f31c3e983 Sep 23 12:39:10 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:10 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7800273-273a-46c2-bfaa-373f31c3e983" returned: 0 in 0.284s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf81d24b-627d-48b3-8cca-d618d55cd0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7800273-273a-46c2-bfaa-373f31c3e983', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b725ec-f6c7-4a4a-8806-3e8dc9a7070c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:10 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Volume volume-b7800273-273a-46c2-bfaa-373f31c3e983 (b7800273-273a-46c2-bfaa-373f31c3e983): created successfully Sep 23 12:39:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b725ec-f6c7-4a4a-8806-3e8dc9a7070c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Flow 'volume_create_manager' (9731cfa8-3a26-4d4a-b915-7ae35bcd3040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:11 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f63c97de-d710-440f-a6dd-e7d5de0ca19c tempest-VolumesListTestJSON-1104474678 None] Created volume successfully. Sep 23 12:39:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ef6f8cb9-072b-4178-9e7d-31b623415247 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "cinder-quobyte-e955234c-87ad-4eca-bf87-b96f79b641bf" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ef6f8cb9-072b-4178-9e7d-31b623415247 tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-e955234c-87ad-4eca-bf87-b96f79b641bf" acquired by "delete_volume" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:11 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[470c3689-e912-42d8-9557-77ebc9e52b94]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ef6f8cb9-072b-4178-9e7d-31b623415247 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:11 devstack sudo[93233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf Sep 23 12:39:11 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:12 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ef6f8cb9-072b-4178-9e7d-31b623415247 tempest-GroupSnapshotsTest-1165375712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf" returned: 0 in 0.581s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ef6f8cb9-072b-4178-9e7d-31b623415247 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:12 devstack sudo[93280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf Sep 23 12:39:12 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:12 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ef6f8cb9-072b-4178-9e7d-31b623415247 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e955234c-87ad-4eca-bf87-b96f79b641bf" returned: 0 in 0.557s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Flow 'volume_create_manager' (9e8cf2a2-4f9f-4137-89f4-febb59f9ac8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a59522-929d-4b04-a562-9774fa5df694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ef6f8cb9-072b-4178-9e7d-31b623415247 tempest-GroupSnapshotsTest-1165375712 None] Lock "cinder-quobyte-e955234c-87ad-4eca-bf87-b96f79b641bf" released by "delete_volume" :: held 1.336s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a59522-929d-4b04-a562-9774fa5df694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-94261332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05e43bf3-3f02-489f-8db6-4d3a8acd79b9,host='devstack@QuobyteHD#QuobyteHD',id=444e1a94-8ffd-4c34-9d0b-c1792957125b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267a5a4b688b4d13b24c2c5fdc32741d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:39:12Z,use_quota=True,user_id='8255a84c95fb4f8c817418a6ab164469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f2927fa-7678-4f7d-9845-9eca14aa75de),volume_type_id=8f2927fa-7678-4f7d-9845-9eca14aa75de)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac87db4-3a47-4f20-96c2-63c733cc09e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac87db4-3a47-4f20-96c2-63c733cc09e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a171bed-ca2d-4e3b-8a4d-8d9bb4cf8743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a171bed-ca2d-4e3b-8a4d-8d9bb4cf8743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '444e1a94-8ffd-4c34-9d0b-c1792957125b', 'volume_name': 'volume-444e1a94-8ffd-4c34-9d0b-c1792957125b', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac7dc60-5207-4d46-a301-873c5c54a370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac7dc60-5207-4d46-a301-873c5c54a370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab187d3-939c-4151-8978-6526223ae5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:12 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Volume 444e1a94-8ffd-4c34-9d0b-c1792957125b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-444e1a94-8ffd-4c34-9d0b-c1792957125b', 'volume_size': 1} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=05e43bf3-3f02-489f-8db6-4d3a8acd79b9,created_at=2026-09-23T10:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-94261332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05e43bf3-3f02-489f-8db6-4d3a8acd79b9,host='devstack@QuobyteHD#QuobyteHD',id=444e1a94-8ffd-4c34-9d0b-c1792957125b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267a5a4b688b4d13b24c2c5fdc32741d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:39:12Z,use_quota=True,user_id='8255a84c95fb4f8c817418a6ab164469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f2927fa-7678-4f7d-9845-9eca14aa75de),volume_type_id=8f2927fa-7678-4f7d-9845-9eca14aa75de)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Creating volume 444e1a94-8ffd-4c34-9d0b-c1792957125b {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:39:12 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:39:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-444e1a94-8ffd-4c34-9d0b-c1792957125b 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:13 devstack sudo[93385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-444e1a94-8ffd-4c34-9d0b-c1792957125b 1073741824 Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-ef6f8cb9-072b-4178-9e7d-31b623415247 tempest-GroupSnapshotsTest-1165375712 None] Created reservations ['8c4dc525-9890-4366-8a67-c50f2e819df2'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:39:13 devstack sudo[93385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:13 devstack cinder-volume[86085]: WARNING cinder.quota [None req-ef6f8cb9-072b-4178-9e7d-31b623415247 tempest-GroupSnapshotsTest-1165375712 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1194098858 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1194098858, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-ef6f8cb9-072b-4178-9e7d-31b623415247 tempest-GroupSnapshotsTest-1165375712 None] Created reservations ['fc117a6e-0ae2-4492-9295-14dc0f361465', 'f74af557-3d83-49bf-a094-7f54f6fecaca', '775e4f17-3200-48fa-a342-a5dba3a7559d', 'de04e8d5-6944-4ac5-ba0c-63809b2219f1'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Flow 'volume_create_manager' (9cf9a6a3-0004-4154-b30a-e2eff7489442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2c9396-e776-447d-a918-3a7674a29a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2c9396-e776-447d-a918-3a7674a29a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-489541931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e8c2de354f043988a8148339ea01db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:39:13Z,use_quota=True,user_id='beb25e4908d34e15aa703a0eeadc6e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef5384d-33f0-4ab7-bb07-d29c3e5b254a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef5384d-33f0-4ab7-bb07-d29c3e5b254a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593dd4fb-cca3-4336-a176-d3609042386d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593dd4fb-cca3-4336-a176-d3609042386d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4cb4744-4e55-413e-bee8-7f0ecc8bcd7e', 'volume_name': 'volume-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6debde52-0960-4777-8a2e-91837a4dfa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6debde52-0960-4777-8a2e-91837a4dfa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a315df3-5fa2-4f09-94e5-559140db00a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:13 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Volume d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e', 'volume_size': 1} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ef6f8cb9-072b-4178-9e7d-31b623415247 tempest-GroupSnapshotsTest-1165375712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ef6f8cb9-072b-4178-9e7d-31b623415247 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ef6f8cb9-072b-4178-9e7d-31b623415247 tempest-GroupSnapshotsTest-1165375712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ef6f8cb9-072b-4178-9e7d-31b623415247 tempest-GroupSnapshotsTest-1165375712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ef6f8cb9-072b-4178-9e7d-31b623415247 tempest-GroupSnapshotsTest-1165375712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ef6f8cb9-072b-4178-9e7d-31b623415247 tempest-GroupSnapshotsTest-1165375712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:13 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:39:13 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:13 devstack sudo[93385]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-444e1a94-8ffd-4c34-9d0b-c1792957125b 1073741824" returned: 0 in 0.684s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-444e1a94-8ffd-4c34-9d0b-c1792957125b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:13 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-444e1a94-8ffd-4c34-9d0b-c1792957125b Sep 23 12:39:13 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:13 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ef6f8cb9-072b-4178-9e7d-31b623415247 tempest-GroupSnapshotsTest-1165375712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.444s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:13 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-ef6f8cb9-072b-4178-9e7d-31b623415247 tempest-GroupSnapshotsTest-1165375712 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:39:13 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ef6f8cb9-072b-4178-9e7d-31b623415247 tempest-GroupSnapshotsTest-1165375712 None] Delete group completed successfully. Sep 23 12:39:14 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-444e1a94-8ffd-4c34-9d0b-c1792957125b" returned: 0 in 0.506s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:39:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.925s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-489541931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e8c2de354f043988a8148339ea01db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:39:13Z,use_quota=True,user_id='beb25e4908d34e15aa703a0eeadc6e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:39:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Creating volume d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:39:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:39:14 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:39:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab187d3-939c-4151-8978-6526223ae5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-444e1a94-8ffd-4c34-9d0b-c1792957125b', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:14 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e 1073741824 Sep 23 12:39:14 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a46cb668-33e2-43bd-bb14-6a360fa3aeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:14 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Volume volume-444e1a94-8ffd-4c34-9d0b-c1792957125b (444e1a94-8ffd-4c34-9d0b-c1792957125b): created successfully Sep 23 12:39:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a46cb668-33e2-43bd-bb14-6a360fa3aeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Flow 'volume_create_manager' (9e8cf2a2-4f9f-4137-89f4-febb59f9ac8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:14 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-90bded4d-3d27-45e1-9812-8628f70531c0 tempest-GroupsTest-270916484 None] Created volume successfully. Sep 23 12:39:15 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e 1073741824" returned: 0 in 0.756s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:15 devstack sudo[93792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e Sep 23 12:39:15 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:15 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e" returned: 0 in 0.313s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:39:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a315df3-5fa2-4f09-94e5-559140db00a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (462135eb-1ac6-43f4-a715-fd5389a4f164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:15 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Volume volume-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e (d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e): created successfully Sep 23 12:39:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (462135eb-1ac6-43f4-a715-fd5389a4f164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Flow 'volume_create_manager' (9cf9a6a3-0004-4154-b30a-e2eff7489442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:15 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-bd4fed25-8d15-409d-9012-4729de890a84 tempest-VolumesListTestJSON-1104474678 None] Created volume successfully. Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Flow 'volume_create_manager' (80b6d422-04af-4b7d-ae07-39238c5972d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd025f4f-995a-4cd3-8ccf-853a7b1a932c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd025f4f-995a-4cd3-8ccf-853a7b1a932c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-789502451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05e43bf3-3f02-489f-8db6-4d3a8acd79b9,host='devstack@QuobyteHD#QuobyteHD',id=4ac66470-34dc-4d4d-841f-92a068bd1a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267a5a4b688b4d13b24c2c5fdc32741d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:39:16Z,use_quota=True,user_id='8255a84c95fb4f8c817418a6ab164469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f2927fa-7678-4f7d-9845-9eca14aa75de),volume_type_id=8f2927fa-7678-4f7d-9845-9eca14aa75de)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b75bf6-58b8-454d-9ca3-9ffd18096f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b75bf6-58b8-454d-9ca3-9ffd18096f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdcae156-6b5d-4875-a920-9c3082f64d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdcae156-6b5d-4875-a920-9c3082f64d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac66470-34dc-4d4d-841f-92a068bd1a15', 'volume_name': 'volume-4ac66470-34dc-4d4d-841f-92a068bd1a15', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (718c779c-95fe-44fd-b1b6-125422a0e44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (718c779c-95fe-44fd-b1b6-125422a0e44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29878a3-30cf-4374-99e0-4e76b44b0567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:16 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Volume 4ac66470-34dc-4d4d-841f-92a068bd1a15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac66470-34dc-4d4d-841f-92a068bd1a15', 'volume_size': 1} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=05e43bf3-3f02-489f-8db6-4d3a8acd79b9,created_at=2026-09-23T10:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-789502451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05e43bf3-3f02-489f-8db6-4d3a8acd79b9,host='devstack@QuobyteHD#QuobyteHD',id=4ac66470-34dc-4d4d-841f-92a068bd1a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267a5a4b688b4d13b24c2c5fdc32741d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:39:16Z,use_quota=True,user_id='8255a84c95fb4f8c817418a6ab164469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f2927fa-7678-4f7d-9845-9eca14aa75de),volume_type_id=8f2927fa-7678-4f7d-9845-9eca14aa75de)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Creating volume 4ac66470-34dc-4d4d-841f-92a068bd1a15 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:39:16 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:39:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4ac66470-34dc-4d4d-841f-92a068bd1a15 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:16 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4ac66470-34dc-4d4d-841f-92a068bd1a15 1073741824 Sep 23 12:39:16 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:17 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4ac66470-34dc-4d4d-841f-92a068bd1a15 1073741824" returned: 0 in 0.759s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Flow 'volume_create_manager' (d5efcd83-d3d4-4f3f-b168-5475cdd0ce93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6754f061-f252-4787-9d52-3c0545f05557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6754f061-f252-4787-9d52-3c0545f05557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2111000945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dded4ff-7119-49c2-9eb8-99307de15ff8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e8c2de354f043988a8148339ea01db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:39:17Z,use_quota=True,user_id='beb25e4908d34e15aa703a0eeadc6e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f889bb7d-afb3-4b61-8eea-a4bda31e635a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f889bb7d-afb3-4b61-8eea-a4bda31e635a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3db8c7e-a565-4654-9be4-56694a3ebcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3db8c7e-a565-4654-9be4-56694a3ebcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dded4ff-7119-49c2-9eb8-99307de15ff8', 'volume_name': 'volume-0dded4ff-7119-49c2-9eb8-99307de15ff8', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c2c9b3-567f-4bed-bf8f-639eec31a84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c2c9b3-567f-4bed-bf8f-639eec31a84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8fff1c-c655-4d5b-aa8c-c58e876d6d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:17 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Volume 0dded4ff-7119-49c2-9eb8-99307de15ff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dded4ff-7119-49c2-9eb8-99307de15ff8', 'volume_size': 1} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4ac66470-34dc-4d4d-841f-92a068bd1a15 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:17 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4ac66470-34dc-4d4d-841f-92a068bd1a15 Sep 23 12:39:17 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:17 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4ac66470-34dc-4d4d-841f-92a068bd1a15" returned: 0 in 0.297s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.306s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2111000945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dded4ff-7119-49c2-9eb8-99307de15ff8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e8c2de354f043988a8148339ea01db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:39:17Z,use_quota=True,user_id='beb25e4908d34e15aa703a0eeadc6e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Creating volume 0dded4ff-7119-49c2-9eb8-99307de15ff8 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:39:17 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0dded4ff-7119-49c2-9eb8-99307de15ff8 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29878a3-30cf-4374-99e0-4e76b44b0567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac66470-34dc-4d4d-841f-92a068bd1a15', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:17 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0dded4ff-7119-49c2-9eb8-99307de15ff8 1073741824 Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3211f980-8a36-40f8-8980-539f64910d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:17 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:17 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Volume volume-4ac66470-34dc-4d4d-841f-92a068bd1a15 (4ac66470-34dc-4d4d-841f-92a068bd1a15): created successfully Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3211f980-8a36-40f8-8980-539f64910d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Flow 'volume_create_manager' (80b6d422-04af-4b7d-ae07-39238c5972d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:17 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f931c813-115f-4b5b-ada7-32a757263267 tempest-GroupsTest-270916484 None] Created volume successfully. Sep 23 12:39:18 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0dded4ff-7119-49c2-9eb8-99307de15ff8 1073741824" returned: 0 in 0.566s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0dded4ff-7119-49c2-9eb8-99307de15ff8 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:18 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0dded4ff-7119-49c2-9eb8-99307de15ff8 Sep 23 12:39:18 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:18 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0dded4ff-7119-49c2-9eb8-99307de15ff8" returned: 0 in 0.290s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:39:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8fff1c-c655-4d5b-aa8c-c58e876d6d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dded4ff-7119-49c2-9eb8-99307de15ff8', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd19bcf8-af22-4ee1-88d5-3f5d40ad3f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:18 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Volume volume-0dded4ff-7119-49c2-9eb8-99307de15ff8 (0dded4ff-7119-49c2-9eb8-99307de15ff8): created successfully Sep 23 12:39:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd19bcf8-af22-4ee1-88d5-3f5d40ad3f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Flow 'volume_create_manager' (d5efcd83-d3d4-4f3f-b168-5475cdd0ce93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:18 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-b475ed8d-3f26-442a-beb7-346949105410 tempest-VolumesListTestJSON-1104474678 None] Created volume successfully. Sep 23 12:39:18 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-2497c8fe-2e3d-4ff1-b8c8-439923be8d8d tempest-GroupsTest-270916484 None] Update group completed successfully. Sep 23 12:39:20 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-9719cd34-1004-45d7-a2c1-66cb871cb528 tempest-GroupsTest-270916484 None] Update group completed successfully. Sep 23 12:39:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] Acquiring lock "cinder-0dded4ff-7119-49c2-9eb8-99307de15ff8-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] Lock "cinder-0dded4ff-7119-49c2-9eb8-99307de15ff8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] Acquiring lock "cinder-quobyte-0dded4ff-7119-49c2-9eb8-99307de15ff8" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] Lock "cinder-quobyte-0dded4ff-7119-49c2-9eb8-99307de15ff8" acquired by "delete_volume" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:21 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c7b2b8-55c0-4c78-85b8-fe8b8dfdc276]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0dded4ff-7119-49c2-9eb8-99307de15ff8 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:21 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0dded4ff-7119-49c2-9eb8-99307de15ff8 Sep 23 12:39:21 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:22 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0dded4ff-7119-49c2-9eb8-99307de15ff8" returned: 0 in 0.447s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0dded4ff-7119-49c2-9eb8-99307de15ff8 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:22 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0dded4ff-7119-49c2-9eb8-99307de15ff8 Sep 23 12:39:22 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Acquiring lock "cinder-quobyte-444e1a94-8ffd-4c34-9d0b-c1792957125b" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Lock "cinder-quobyte-444e1a94-8ffd-4c34-9d0b-c1792957125b" acquired by "delete_volume" :: waited 0.052s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:22 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d3d2c0-5649-4a49-afa0-2e1c1f1f800c]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-444e1a94-8ffd-4c34-9d0b-c1792957125b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:22 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0dded4ff-7119-49c2-9eb8-99307de15ff8" returned: 0 in 0.543s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] Lock "cinder-quobyte-0dded4ff-7119-49c2-9eb8-99307de15ff8" released by "delete_volume" :: held 1.069s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:22 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-444e1a94-8ffd-4c34-9d0b-c1792957125b Sep 23 12:39:22 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:22 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] Created reservations ['aefa5a68-6ca2-4a4b-b335-4c6e36a87726', 'e4c473e1-9161-4573-9117-369d72bd37d8', '85a529d0-c535-4071-95a7-11cb5876a111', '4ad59f2a-093c-4459-8ecb-ee46aa863f5c'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:39:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:23 devstack sudo[93830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:39:23 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] Acquiring lock "cinder-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:23 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-444e1a94-8ffd-4c34-9d0b-c1792957125b" returned: 0 in 0.565s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-444e1a94-8ffd-4c34-9d0b-c1792957125b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] Lock "cinder-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:23 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-444e1a94-8ffd-4c34-9d0b-c1792957125b Sep 23 12:39:23 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] Acquiring lock "cinder-quobyte-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] Lock "cinder-quobyte-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e" acquired by "delete_volume" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:23 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8690c7-7bf7-438d-9a7d-b19a41d5c2c8]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:23 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.495s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:23 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:39:23 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] Deleted volume successfully. Sep 23 12:39:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0acca9d6-39fb-44d1-a4bf-77c1a6f4fb65 tempest-VolumesListTestJSON-1104474678 None] Lock "cinder-0dded4ff-7119-49c2-9eb8-99307de15ff8-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:23 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e Sep 23 12:39:23 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:23 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-444e1a94-8ffd-4c34-9d0b-c1792957125b" returned: 0 in 0.450s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Lock "cinder-quobyte-444e1a94-8ffd-4c34-9d0b-c1792957125b" released by "delete_volume" :: held 1.162s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Acquiring lock "cinder-quobyte-4ac66470-34dc-4d4d-841f-92a068bd1a15" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Lock "cinder-quobyte-4ac66470-34dc-4d4d-841f-92a068bd1a15" acquired by "delete_volume" :: waited 0.024s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:23 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba74a14b-a59d-4db2-b8a0-6955fcb25ecf]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4ac66470-34dc-4d4d-841f-92a068bd1a15 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:23 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4ac66470-34dc-4d4d-841f-92a068bd1a15 Sep 23 12:39:23 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:24 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e" returned: 0 in 0.663s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:24 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e Sep 23 12:39:24 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:24 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4ac66470-34dc-4d4d-841f-92a068bd1a15" returned: 0 in 0.531s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4ac66470-34dc-4d4d-841f-92a068bd1a15 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:24 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4ac66470-34dc-4d4d-841f-92a068bd1a15 Sep 23 12:39:24 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:24 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e" returned: 0 in 0.369s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] Lock "cinder-quobyte-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e" released by "delete_volume" :: held 1.104s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:24 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] Created reservations ['fc8d972a-b645-46d5-8691-96d15cb84851', '908215bc-64c0-4fd4-bac6-2f6a3ea412ac', '05c437b6-0472-4517-84f4-ba1fb522ca9d', 'a8f400e7-3c41-4e70-a2ae-f2e8a484b44a'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:39:24 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4ac66470-34dc-4d4d-841f-92a068bd1a15" returned: 0 in 0.350s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Lock "cinder-quobyte-4ac66470-34dc-4d4d-841f-92a068bd1a15" released by "delete_volume" :: held 0.950s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:24 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:39:24 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:24 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Created reservations ['f65e39a1-38f7-477d-9348-f4cfb383e457'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:39:24 devstack cinder-volume[86085]: WARNING cinder.quota [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1649386812 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1649386812, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:39:24 devstack cinder-volume[86085]: WARNING cinder.quota [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1649386812 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1649386812, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:39:24 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Created reservations ['062376df-4b0e-47f6-9e62-1d2e8da9c171', 'bf207196-8cf2-4d14-80be-f35924c0292a', '806627e2-7581-4c2f-b91b-20f68b84f896', '68c6012c-eeec-456f-8589-06ccd5be88e0'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:39:24 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.292s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:25 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:39:25 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Created reservations ['59fd2ecc-7641-4d62-9724-3cd2e66aa5dd', 'dc9103a1-1690-43f9-b873-5c5e6faaf6c4', '2316a760-18f2-48d8-8e40-156ac1a9235c', '514d6f79-0a3b-4532-a56e-2b53321c45d1'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:39:25 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] Deleted volume successfully. Sep 23 12:39:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4c7b0ebc-8d84-41de-9a93-5f039cd8461e tempest-VolumesListTestJSON-1104474678 None] Lock "cinder-d4cb4744-4e55-413e-bee8-7f0ecc8bcd7e-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:25 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:39:25 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:25 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.264s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:25 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:39:25 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-16f1771e-f44d-4d05-9983-234834ef08f1 tempest-GroupsTest-270916484 None] Delete group completed successfully. Sep 23 12:39:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] Acquiring lock "cinder-b7800273-273a-46c2-bfaa-373f31c3e983-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] Lock "cinder-b7800273-273a-46c2-bfaa-373f31c3e983-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] Acquiring lock "cinder-quobyte-b7800273-273a-46c2-bfaa-373f31c3e983" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] Lock "cinder-quobyte-b7800273-273a-46c2-bfaa-373f31c3e983" acquired by "delete_volume" :: waited 0.025s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:25 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[21949c6b-5955-4376-8798-c0c9393db3d6]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7800273-273a-46c2-bfaa-373f31c3e983 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:25 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7800273-273a-46c2-bfaa-373f31c3e983 Sep 23 12:39:25 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:26 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7800273-273a-46c2-bfaa-373f31c3e983" returned: 0 in 0.439s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7800273-273a-46c2-bfaa-373f31c3e983 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:26 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7800273-273a-46c2-bfaa-373f31c3e983 Sep 23 12:39:26 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:26 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b7800273-273a-46c2-bfaa-373f31c3e983" returned: 0 in 0.384s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] Lock "cinder-quobyte-b7800273-273a-46c2-bfaa-373f31c3e983" released by "delete_volume" :: held 0.895s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:26 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] Created reservations ['76963ec4-945f-4a3c-b43c-b4a6366433ed', 'fd0478a9-7a3a-4139-b112-1515b8705d8b', '05ad4d91-72fe-4c0c-94b0-d1f0e8a12bde', '43998dcb-61a0-4f08-8b1a-d82fee6587cb'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:39:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:26 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:39:26 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:27 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.579s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:27 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:39:27 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] Deleted volume successfully. Sep 23 12:39:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-41e93558-c34a-4d94-a634-7b0987e77de9 tempest-VolumesListTestJSON-1104474678 None] Lock "cinder-b7800273-273a-46c2-bfaa-373f31c3e983-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:34 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:39:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Flow 'volume_create_manager' (1269a635-620d-4a54-917d-4f4db42d8903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0891ae74-59cf-45f6-a658-754f856ab7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0891ae74-59cf-45f6-a658-754f856ab7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-472142200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8886f23-b1b8-4c63-abcd-e8f548a4b72d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b2f34e95b5a4c01bdca8d284b532176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:39:35Z,use_quota=True,user_id='80aff26ec807429d88564aa49243bb3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420623cd-c852-44a1-b32d-b14e9adf03e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420623cd-c852-44a1-b32d-b14e9adf03e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24352763-51a2-4ed8-81be-d5abc1ff5c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24352763-51a2-4ed8-81be-d5abc1ff5c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8886f23-b1b8-4c63-abcd-e8f548a4b72d', 'volume_name': 'volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb4408a7-4648-49b2-8d65-40ae5e854fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb4408a7-4648-49b2-8d65-40ae5e854fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f009cdeb-897e-41a5-8e4c-394f644892ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:35 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Volume f8886f23-b1b8-4c63-abcd-e8f548a4b72d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d', 'volume_size': 1} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-472142200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8886f23-b1b8-4c63-abcd-e8f548a4b72d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b2f34e95b5a4c01bdca8d284b532176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:39:35Z,use_quota=True,user_id='80aff26ec807429d88564aa49243bb3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Creating volume f8886f23-b1b8-4c63-abcd-e8f548a4b72d {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:39:35 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:35 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d 1073741824 Sep 23 12:39:35 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:35 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d 1073741824" returned: 0 in 0.520s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:35 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d Sep 23 12:39:35 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:35 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" returned: 0 in 0.299s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f009cdeb-897e-41a5-8e4c-394f644892ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff680ef-9e5d-4246-8ed2-8afb244d56c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:35 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Volume volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d (f8886f23-b1b8-4c63-abcd-e8f548a4b72d): created successfully Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff680ef-9e5d-4246-8ed2-8afb244d56c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Flow 'volume_create_manager' (1269a635-620d-4a54-917d-4f4db42d8903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:35 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-8669b83a-99c4-44de-a010-c6c336a506fa tempest-SnapshotsActionsTest-757698842 None] Created volume successfully. Sep 23 12:39:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-72eef5b3-4fab-45a5-b772-7d5d75007bd6 tempest-SnapshotsActionsTest-757698842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-72eef5b3-4fab-45a5-b772-7d5d75007bd6 tempest-SnapshotsActionsTest-757698842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-72eef5b3-4fab-45a5-b772-7d5d75007bd6 tempest-SnapshotsActionsTest-757698842 None] Creating offline snapshot 0bf5d8a7-7057-44f8-8f9b-daee7f224acd of volume f8886f23-b1b8-4c63-abcd-e8f548a4b72d {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:39:37 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a71e3d-749c-435b-8670-23eb6334189a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-72eef5b3-4fab-45a5-b772-7d5d75007bd6 tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:37 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d Sep 23 12:39:37 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:38 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-72eef5b3-4fab-45a5-b772-7d5d75007bd6 tempest-SnapshotsActionsTest-757698842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" returned: 0 in 0.793s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-72eef5b3-4fab-45a5-b772-7d5d75007bd6 tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:38 devstack sudo[93965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd 1G Sep 23 12:39:38 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:38 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-72eef5b3-4fab-45a5-b772-7d5d75007bd6 tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd 1G" returned: 0 in 0.568s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-72eef5b3-4fab-45a5-b772-7d5d75007bd6 tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:38 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd Sep 23 12:39:38 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:39 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-72eef5b3-4fab-45a5-b772-7d5d75007bd6 tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd" returned: 0 in 0.363s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:39 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-72eef5b3-4fab-45a5-b772-7d5d75007bd6 tempest-SnapshotsActionsTest-757698842 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd is being set with open permissions: ugo+rw Sep 23 12:39:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-72eef5b3-4fab-45a5-b772-7d5d75007bd6 tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:39 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd Sep 23 12:39:39 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:39 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-72eef5b3-4fab-45a5-b772-7d5d75007bd6 tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd" returned: 0 in 0.333s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-72eef5b3-4fab-45a5-b772-7d5d75007bd6 tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:39 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.info Sep 23 12:39:39 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:39 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-72eef5b3-4fab-45a5-b772-7d5d75007bd6 tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.info" returned: 0 in 0.414s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:39 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-72eef5b3-4fab-45a5-b772-7d5d75007bd6 tempest-SnapshotsActionsTest-757698842 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.info is being set with open permissions: ugo+rw Sep 23 12:39:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-72eef5b3-4fab-45a5-b772-7d5d75007bd6 tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:39 devstack sudo[93986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.info Sep 23 12:39:39 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:40 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-72eef5b3-4fab-45a5-b772-7d5d75007bd6 tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.info" returned: 0 in 0.418s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-72eef5b3-4fab-45a5-b772-7d5d75007bd6 tempest-SnapshotsActionsTest-757698842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.044s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:40 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-64bd489a-ce36-4c22-847f-f73a51dcbb55 req-3c110803-3ce7-4291-9b2d-c5e49ebe5e0c tempest-AttachVolumeTestJSON-539427221 None] Terminate volume connection completed successfully. Sep 23 12:39:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-64bd489a-ce36-4c22-847f-f73a51dcbb55 req-3c110803-3ce7-4291-9b2d-c5e49ebe5e0c tempest-AttachVolumeTestJSON-539427221 None] Deleting attachment dfae2661-1247-4a54-982b-6d46ac1efa17. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:39:40 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-72eef5b3-4fab-45a5-b772-7d5d75007bd6 tempest-SnapshotsActionsTest-757698842 None] Create snapshot completed successfully Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Flow 'volume_create_manager' (805779b7-25fa-4122-bb12-4bd0b3dd25e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad44913-5fdb-4567-96b4-4fc26304cef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad44913-5fdb-4567-96b4-4fc26304cef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1501456052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4844c84a-3ac2-4e17-9171-1845a111acc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02e149cc29b44d69c7c8caf0bf276b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:39:41Z,use_quota=True,user_id='5699c9637b3547579723d0c6b8b0c525',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfddbb3-f04e-41f8-a4d8-d3b3c8f11eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfddbb3-f04e-41f8-a4d8-d3b3c8f11eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269334d0-dbdf-4f56-b64e-a6caf8983420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269334d0-dbdf-4f56-b64e-a6caf8983420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4844c84a-3ac2-4e17-9171-1845a111acc3', 'volume_name': 'volume-4844c84a-3ac2-4e17-9171-1845a111acc3', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b7e6a2-cd54-4ed5-8fd8-2f8e35acb162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b7e6a2-cd54-4ed5-8fd8-2f8e35acb162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c22b276-2c54-47c6-b1f7-7a3b3909a53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:41 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Volume 4844c84a-3ac2-4e17-9171-1845a111acc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4844c84a-3ac2-4e17-9171-1845a111acc3', 'volume_size': 1} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1501456052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4844c84a-3ac2-4e17-9171-1845a111acc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02e149cc29b44d69c7c8caf0bf276b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:39:41Z,use_quota=True,user_id='5699c9637b3547579723d0c6b8b0c525',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Creating volume 4844c84a-3ac2-4e17-9171-1845a111acc3 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:39:41 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4844c84a-3ac2-4e17-9171-1845a111acc3 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:41 devstack sudo[93994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4844c84a-3ac2-4e17-9171-1845a111acc3 1073741824 Sep 23 12:39:41 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:41 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:39:41 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dc01988e-8d56-42ec-8fcd-5e36fe1279bd tempest-SnapshotsActionsTest-757698842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:41 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.433s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:39:41 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4844c84a-3ac2-4e17-9171-1845a111acc3 1073741824" returned: 0 in 0.751s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4844c84a-3ac2-4e17-9171-1845a111acc3 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:42 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4844c84a-3ac2-4e17-9171-1845a111acc3 Sep 23 12:39:42 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:42 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4844c84a-3ac2-4e17-9171-1845a111acc3" returned: 0 in 0.255s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:39:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dc01988e-8d56-42ec-8fcd-5e36fe1279bd tempest-SnapshotsActionsTest-757698842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.783s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c22b276-2c54-47c6-b1f7-7a3b3909a53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4844c84a-3ac2-4e17-9171-1845a111acc3', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce20688-45d5-4944-9aee-d823814336f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-dc01988e-8d56-42ec-8fcd-5e36fe1279bd tempest-SnapshotsActionsTest-757698842 None] Creating offline snapshot 93a323a4-e1c9-48aa-9952-c1dbedf814da of volume f8886f23-b1b8-4c63-abcd-e8f548a4b72d {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:39:42 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Volume volume-4844c84a-3ac2-4e17-9171-1845a111acc3 (4844c84a-3ac2-4e17-9171-1845a111acc3): created successfully Sep 23 12:39:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce20688-45d5-4944-9aee-d823814336f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Flow 'volume_create_manager' (805779b7-25fa-4122-bb12-4bd0b3dd25e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:42 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c36a689-f8ae-4a66-a538-f67101ef41fc]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dc01988e-8d56-42ec-8fcd-5e36fe1279bd tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:42 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-5536b56e-1a1f-4725-91dd-1a98a39a8eb0 tempest-VolumesServicesTestJSON-226249788 None] Created volume successfully. Sep 23 12:39:42 devstack sudo[94011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd Sep 23 12:39:42 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:42 devstack sudo[94011]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dc01988e-8d56-42ec-8fcd-5e36fe1279bd tempest-SnapshotsActionsTest-757698842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd" returned: 0 in 0.427s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-dc01988e-8d56-42ec-8fcd-5e36fe1279bd tempest-SnapshotsActionsTest-757698842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:39:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dc01988e-8d56-42ec-8fcd-5e36fe1279bd tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:42 devstack sudo[94021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da 1G Sep 23 12:39:42 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] Acquiring lock "cinder-4844c84a-3ac2-4e17-9171-1845a111acc3-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] Lock "cinder-4844c84a-3ac2-4e17-9171-1845a111acc3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] Acquiring lock "cinder-quobyte-4844c84a-3ac2-4e17-9171-1845a111acc3" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:43 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] Lock "cinder-quobyte-4844c84a-3ac2-4e17-9171-1845a111acc3" acquired by "delete_volume" :: waited 0.026s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dc01988e-8d56-42ec-8fcd-5e36fe1279bd tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da 1G" returned: 0 in 0.757s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dc01988e-8d56-42ec-8fcd-5e36fe1279bd tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:43 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6305ba2-9665-4002-9e9e-02daf6a91fae]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4844c84a-3ac2-4e17-9171-1845a111acc3 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:43 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da Sep 23 12:39:43 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:43 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4844c84a-3ac2-4e17-9171-1845a111acc3 Sep 23 12:39:43 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:43 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dc01988e-8d56-42ec-8fcd-5e36fe1279bd tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da" returned: 0 in 0.389s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:43 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-dc01988e-8d56-42ec-8fcd-5e36fe1279bd tempest-SnapshotsActionsTest-757698842 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da is being set with open permissions: ugo+rw Sep 23 12:39:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dc01988e-8d56-42ec-8fcd-5e36fe1279bd tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:43 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da Sep 23 12:39:43 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:44 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4844c84a-3ac2-4e17-9171-1845a111acc3" returned: 0 in 0.495s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4844c84a-3ac2-4e17-9171-1845a111acc3 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:44 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4844c84a-3ac2-4e17-9171-1845a111acc3 Sep 23 12:39:44 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:44 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dc01988e-8d56-42ec-8fcd-5e36fe1279bd tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da" returned: 0 in 0.328s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dc01988e-8d56-42ec-8fcd-5e36fe1279bd tempest-SnapshotsActionsTest-757698842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.104s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:44 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-dc01988e-8d56-42ec-8fcd-5e36fe1279bd tempest-SnapshotsActionsTest-757698842 None] Create snapshot completed successfully Sep 23 12:39:44 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4844c84a-3ac2-4e17-9171-1845a111acc3" returned: 0 in 0.407s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] Lock "cinder-quobyte-4844c84a-3ac2-4e17-9171-1845a111acc3" released by "delete_volume" :: held 0.978s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:44 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] Created reservations ['f38341ee-ea84-4342-a12a-7e8d1d6a1111', '88dd123d-cd3d-4ff8-ae82-87372114b5d5', 'cb58722a-41b1-43b8-9d65-8b6382d10e8e', 'c52fcc61-86e9-407b-9965-74e15cc87b9a'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:39:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:44 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:44 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:44 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:39:44 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] Acquiring lock "cinder-93a323a4-e1c9-48aa-9952-c1dbedf814da-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-93a323a4-e1c9-48aa-9952-c1dbedf814da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] Acquiring lock "cinder-quobyte-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-quobyte-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] Acquiring lock "cinder-quobyte-93a323a4-e1c9-48aa-9952-c1dbedf814da" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-quobyte-93a323a4-e1c9-48aa-9952-c1dbedf814da" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] Deleting offline snapshot 93a323a4-e1c9-48aa-9952-c1dbedf814da of volume f8886f23-b1b8-4c63-abcd-e8f548a4b72d {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:39:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] snapshot_file for this snap is: volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:39:45 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c583e84a-73af-4844-908f-479fc2248b5d]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:45 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.411s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:45 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:39:45 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] Deleted volume successfully. Sep 23 12:39:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7c4ae8e6-533b-4d06-add2-6fc384ac872a tempest-VolumesServicesTestJSON-226249788 None] Lock "cinder-4844c84a-3ac2-4e17-9171-1845a111acc3-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:45 devstack sudo[94073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da Sep 23 12:39:45 devstack sudo[94073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:45 devstack sudo[94073]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da" returned: 0 in 0.737s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:39:45 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6827c720-a743-434c-9250-102830413cce]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:46 devstack sudo[94123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd Sep 23 12:39:46 devstack sudo[94123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:46 devstack sudo[94123]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd" returned: 0 in 0.953s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:46 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:39:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:46 devstack sudo[94154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da Sep 23 12:39:46 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:47 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da" returned: 0 in 0.752s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:47 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da Sep 23 12:39:47 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:47 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.93a323a4-e1c9-48aa-9952-c1dbedf814da" returned: 0 in 0.322s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-quobyte-93a323a4-e1c9-48aa-9952-c1dbedf814da" released by "_delete_snapshot" :: held 2.961s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-quobyte-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" released by "delete_snapshot" :: held 3.017s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:48 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] Created reservations ['b3a5f05b-3bd6-4a32-a9d3-89d9dd3b744b', '0ab22c9a-810b-45cd-b313-18597c151b39', 'c3b633e5-ccc0-4462-9559-26bf0297a6aa', '21b818b4-2ce5-424a-8abd-a7e28d8d1714'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:39:48 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] Delete snapshot completed successfully. Sep 23 12:39:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d6e97ea6-5ceb-4024-a5c9-a68a10514f88 tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-93a323a4-e1c9-48aa-9952-c1dbedf814da-delete_snapshot" released by "delete_snapshot" :: held 3.375s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-820844b2-3e57-4f3c-92b0-652528a5a180 tempest-SnapshotsActionsTest-757698842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-820844b2-3e57-4f3c-92b0-652528a5a180 tempest-SnapshotsActionsTest-757698842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-820844b2-3e57-4f3c-92b0-652528a5a180 tempest-SnapshotsActionsTest-757698842 None] Creating offline snapshot fb63aedc-d62e-4488-9917-86da79233693 of volume f8886f23-b1b8-4c63-abcd-e8f548a4b72d {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:39:50 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1fbc9e-560f-4155-9eb4-66c5d5aae658]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-820844b2-3e57-4f3c-92b0-652528a5a180 tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:50 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd Sep 23 12:39:50 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:50 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-820844b2-3e57-4f3c-92b0-652528a5a180 tempest-SnapshotsActionsTest-757698842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd" returned: 0 in 0.569s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-820844b2-3e57-4f3c-92b0-652528a5a180 tempest-SnapshotsActionsTest-757698842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:39:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-820844b2-3e57-4f3c-92b0-652528a5a180 tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:50 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693 1G Sep 23 12:39:50 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:51 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-820844b2-3e57-4f3c-92b0-652528a5a180 tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693 1G" returned: 0 in 0.567s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-820844b2-3e57-4f3c-92b0-652528a5a180 tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:51 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693 Sep 23 12:39:51 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:51 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-820844b2-3e57-4f3c-92b0-652528a5a180 tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693" returned: 0 in 0.396s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:51 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-820844b2-3e57-4f3c-92b0-652528a5a180 tempest-SnapshotsActionsTest-757698842 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693 is being set with open permissions: ugo+rw Sep 23 12:39:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-820844b2-3e57-4f3c-92b0-652528a5a180 tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:51 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693 Sep 23 12:39:51 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:51 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-820844b2-3e57-4f3c-92b0-652528a5a180 tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693" returned: 0 in 0.287s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-820844b2-3e57-4f3c-92b0-652528a5a180 tempest-SnapshotsActionsTest-757698842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:51 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-820844b2-3e57-4f3c-92b0-652528a5a180 tempest-SnapshotsActionsTest-757698842 None] Create snapshot completed successfully Sep 23 12:39:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] Acquiring lock "cinder-fb63aedc-d62e-4488-9917-86da79233693-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-fb63aedc-d62e-4488-9917-86da79233693-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] Acquiring lock "cinder-quobyte-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-quobyte-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] Acquiring lock "cinder-quobyte-fb63aedc-d62e-4488-9917-86da79233693" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-quobyte-fb63aedc-d62e-4488-9917-86da79233693" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] Deleting offline snapshot fb63aedc-d62e-4488-9917-86da79233693 of volume f8886f23-b1b8-4c63-abcd-e8f548a4b72d {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:39:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] snapshot_file for this snap is: volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:39:52 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c194615f-5913-4af0-8637-235ba91c6e6e]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:52 devstack sudo[94194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693 Sep 23 12:39:52 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:52 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693" returned: 0 in 0.545s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:39:52 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a794eeb-35a9-4ce1-a7da-3b509f58818b]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:53 devstack sudo[94199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd Sep 23 12:39:53 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:53 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd" returned: 0 in 0.499s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:39:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:53 devstack sudo[94206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693 Sep 23 12:39:53 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:53 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693" returned: 0 in 0.505s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:54 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693 Sep 23 12:39:54 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:54 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.fb63aedc-d62e-4488-9917-86da79233693" returned: 0 in 0.451s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-quobyte-fb63aedc-d62e-4488-9917-86da79233693" released by "_delete_snapshot" :: held 2.188s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-quobyte-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" released by "delete_snapshot" :: held 2.227s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:54 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] Created reservations ['150072be-8d1e-40e0-9d24-0d08d450ca20', 'ee36c2a3-947e-4655-9ce6-a49782353144', 'e650de59-a96c-411a-9f6f-9356351cd3be', 'd6081f18-4dee-449f-ab16-85a61bfa7409'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:39:54 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] Delete snapshot completed successfully. Sep 23 12:39:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-bbc5e7fa-8348-4d51-b7ee-f088e6b3c494 tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-fb63aedc-d62e-4488-9917-86da79233693-delete_snapshot" released by "delete_snapshot" :: held 2.561s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Flow 'volume_create_manager' (087a8ac4-64f8-4acb-8736-64640a8ce944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcfe5fd6-5c16-4734-b9cf-749468955875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcfe5fd6-5c16-4734-b9cf-749468955875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1249413430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a8d575-5994-427b-a394-23e7106e647d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b95eb8cff44d420898db1d5f32c5c9c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:39:55Z,use_quota=True,user_id='87a912a910984bc1b6a980815aae2919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83e3d964-89a5-4fa0-a929-99c4fed8dfb1),volume_type_id=83e3d964-89a5-4fa0-a929-99c4fed8dfb1)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9365688b-95e0-4a59-a39a-af663a3eabaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9365688b-95e0-4a59-a39a-af663a3eabaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb91b0ae-e88e-4c27-b02d-76f6d73de509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb91b0ae-e88e-4c27-b02d-76f6d73de509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1a8d575-5994-427b-a394-23e7106e647d', 'volume_name': 'volume-d1a8d575-5994-427b-a394-23e7106e647d', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f352c596-af5a-4883-9a4c-42f08d8a9cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f352c596-af5a-4883-9a4c-42f08d8a9cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4290a0bf-01fe-4260-ab9d-b682e028ffee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:55 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Volume d1a8d575-5994-427b-a394-23e7106e647d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1a8d575-5994-427b-a394-23e7106e647d', 'volume_size': 1} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1249413430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a8d575-5994-427b-a394-23e7106e647d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b95eb8cff44d420898db1d5f32c5c9c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:39:55Z,use_quota=True,user_id='87a912a910984bc1b6a980815aae2919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83e3d964-89a5-4fa0-a929-99c4fed8dfb1),volume_type_id=83e3d964-89a5-4fa0-a929-99c4fed8dfb1)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Creating volume d1a8d575-5994-427b-a394-23e7106e647d {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:39:55 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:39:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d1a8d575-5994-427b-a394-23e7106e647d 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:55 devstack sudo[94214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d1a8d575-5994-427b-a394-23e7106e647d 1073741824 Sep 23 12:39:55 devstack sudo[94214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:56 devstack sudo[94214]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d1a8d575-5994-427b-a394-23e7106e647d 1073741824" returned: 0 in 0.629s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ddb59f91-6d45-4f4a-ac98-c295aaf4baeb tempest-SnapshotsActionsTest-757698842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d1a8d575-5994-427b-a394-23e7106e647d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:56 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d1a8d575-5994-427b-a394-23e7106e647d Sep 23 12:39:56 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:56 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d1a8d575-5994-427b-a394-23e7106e647d" returned: 0 in 0.284s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:39:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ddb59f91-6d45-4f4a-ac98-c295aaf4baeb tempest-SnapshotsActionsTest-757698842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.309s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4290a0bf-01fe-4260-ab9d-b682e028ffee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1a8d575-5994-427b-a394-23e7106e647d', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55222ca4-3e5c-4df8-8659-94a3206ed7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:39:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ddb59f91-6d45-4f4a-ac98-c295aaf4baeb tempest-SnapshotsActionsTest-757698842 None] Creating offline snapshot f7927352-f064-4ef0-ba16-35aed0362ff2 of volume f8886f23-b1b8-4c63-abcd-e8f548a4b72d {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:39:56 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Volume volume-d1a8d575-5994-427b-a394-23e7106e647d (d1a8d575-5994-427b-a394-23e7106e647d): created successfully Sep 23 12:39:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55222ca4-3e5c-4df8-8659-94a3206ed7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:39:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Flow 'volume_create_manager' (087a8ac4-64f8-4acb-8736-64640a8ce944) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:39:56 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[869adb3f-a34f-4c7a-80df-c34f3cbc015a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ddb59f91-6d45-4f4a-ac98-c295aaf4baeb tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:56 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-76189e0d-9df5-4e8f-8344-d0d89789d798 tempest-VolumeTypesAccessTest-1300379146 None] Created volume successfully. Sep 23 12:39:56 devstack sudo[94223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd Sep 23 12:39:56 devstack sudo[94223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:56 devstack sudo[94223]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ddb59f91-6d45-4f4a-ac98-c295aaf4baeb tempest-SnapshotsActionsTest-757698842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd" returned: 0 in 0.445s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ddb59f91-6d45-4f4a-ac98-c295aaf4baeb tempest-SnapshotsActionsTest-757698842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:39:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ddb59f91-6d45-4f4a-ac98-c295aaf4baeb tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:56 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2 1G Sep 23 12:39:56 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:57 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ddb59f91-6d45-4f4a-ac98-c295aaf4baeb tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2 1G" returned: 0 in 0.608s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ddb59f91-6d45-4f4a-ac98-c295aaf4baeb tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:57 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2 Sep 23 12:39:57 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] Acquiring lock "cinder-d1a8d575-5994-427b-a394-23e7106e647d-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] Lock "cinder-d1a8d575-5994-427b-a394-23e7106e647d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] Acquiring lock "cinder-quobyte-d1a8d575-5994-427b-a394-23e7106e647d" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] Lock "cinder-quobyte-d1a8d575-5994-427b-a394-23e7106e647d" acquired by "delete_volume" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:57 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[082b46de-71f0-47bc-9538-e3251c1a86bb]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d1a8d575-5994-427b-a394-23e7106e647d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:57 devstack sudo[94235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d1a8d575-5994-427b-a394-23e7106e647d Sep 23 12:39:57 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:58 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ddb59f91-6d45-4f4a-ac98-c295aaf4baeb tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2" returned: 0 in 0.515s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:58 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-ddb59f91-6d45-4f4a-ac98-c295aaf4baeb tempest-SnapshotsActionsTest-757698842 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2 is being set with open permissions: ugo+rw Sep 23 12:39:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ddb59f91-6d45-4f4a-ac98-c295aaf4baeb tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:58 devstack sudo[94241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2 Sep 23 12:39:58 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:58 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ddb59f91-6d45-4f4a-ac98-c295aaf4baeb tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2" returned: 0 in 0.378s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:58 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d1a8d575-5994-427b-a394-23e7106e647d" returned: 0 in 0.590s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d1a8d575-5994-427b-a394-23e7106e647d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:58 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d1a8d575-5994-427b-a394-23e7106e647d Sep 23 12:39:58 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ddb59f91-6d45-4f4a-ac98-c295aaf4baeb tempest-SnapshotsActionsTest-757698842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.138s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:58 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ddb59f91-6d45-4f4a-ac98-c295aaf4baeb tempest-SnapshotsActionsTest-757698842 None] Create snapshot completed successfully Sep 23 12:39:58 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d1a8d575-5994-427b-a394-23e7106e647d" returned: 0 in 0.305s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] Lock "cinder-quobyte-d1a8d575-5994-427b-a394-23e7106e647d" released by "delete_volume" :: held 0.970s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:58 devstack cinder-volume[86085]: WARNING cinder.quota [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1696183778 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1696183778, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:39:58 devstack cinder-volume[86085]: WARNING cinder.quota [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1696183778 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1696183778, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:39:58 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] Created reservations ['b5a67b76-9b5a-48d1-804a-0f1401b82c94', '93fa389f-47ec-424e-8d8e-96decd1ce24b', 'da22b813-378b-4631-8bdd-2cba2452e054', 'ed7d736f-d116-4c23-8263-0e8182dc2670'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:39:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:39:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:39:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:39:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:39:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:39:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:59 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:39:59 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:39:59 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Sep 23 12:39:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] Acquiring lock "cinder-f7927352-f064-4ef0-ba16-35aed0362ff2-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.427s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:39:59 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:39:59 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] Deleted volume successfully. Sep 23 12:39:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-f7927352-f064-4ef0-ba16-35aed0362ff2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] Acquiring lock "cinder-quobyte-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f080459c-aaca-4924-aff5-628388780f00 tempest-VolumeTypesAccessTest-1300379146 None] Lock "cinder-d1a8d575-5994-427b-a394-23e7106e647d-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:39:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-quobyte-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] Acquiring lock "cinder-quobyte-f7927352-f064-4ef0-ba16-35aed0362ff2" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:39:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-quobyte-f7927352-f064-4ef0-ba16-35aed0362ff2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:39:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] Deleting offline snapshot f7927352-f064-4ef0-ba16-35aed0362ff2 of volume f8886f23-b1b8-4c63-abcd-e8f548a4b72d {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:39:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] snapshot_file for this snap is: volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:39:59 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f330525-0315-412d-84be-f893538705dc]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:39:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:39:59 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2 Sep 23 12:39:59 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:00 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2" returned: 0 in 0.516s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:40:00 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[16537494-5aac-4b6b-b635-aac2bc786339]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:40:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:00 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd Sep 23 12:40:00 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:00 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd" returned: 0 in 0.590s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:40:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:00 devstack sudo[94267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2 Sep 23 12:40:00 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:01 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2" returned: 0 in 0.656s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:01 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2 Sep 23 12:40:01 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:01 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.f7927352-f064-4ef0-ba16-35aed0362ff2" returned: 0 in 0.356s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-quobyte-f7927352-f064-4ef0-ba16-35aed0362ff2" released by "_delete_snapshot" :: held 2.312s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-quobyte-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" released by "delete_snapshot" :: held 2.340s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:01 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] Created reservations ['0a1db99d-e8ab-4222-8fbf-480fee1548b7', 'c4187b12-3192-4519-97e4-8c0f4ef256b0', '61c40ee5-86ed-47d2-8519-0580c761b2fd', '96f3821a-d9bb-42d7-9ea6-6900ab5833bd'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:40:01 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] Delete snapshot completed successfully. Sep 23 12:40:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6e0f352c-2741-48da-bf59-414bb9b84b8b tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-f7927352-f064-4ef0-ba16-35aed0362ff2-delete_snapshot" released by "delete_snapshot" :: held 2.532s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5e974541-de40-4e30-8767-8adfe169baf1 tempest-SnapshotsActionsTest-757698842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5e974541-de40-4e30-8767-8adfe169baf1 tempest-SnapshotsActionsTest-757698842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-5e974541-de40-4e30-8767-8adfe169baf1 tempest-SnapshotsActionsTest-757698842 None] Creating offline snapshot 66f41cb0-2d9b-47f1-b847-ca991df334f6 of volume f8886f23-b1b8-4c63-abcd-e8f548a4b72d {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:40:03 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c78e6b-93b4-439b-a860-d56e160a74c3]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:40:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5e974541-de40-4e30-8767-8adfe169baf1 tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:03 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd Sep 23 12:40:03 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:03 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5e974541-de40-4e30-8767-8adfe169baf1 tempest-SnapshotsActionsTest-757698842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd" returned: 0 in 0.473s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-5e974541-de40-4e30-8767-8adfe169baf1 tempest-SnapshotsActionsTest-757698842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:40:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5e974541-de40-4e30-8767-8adfe169baf1 tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:03 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6 1G Sep 23 12:40:03 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:04 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5e974541-de40-4e30-8767-8adfe169baf1 tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6 1G" returned: 0 in 0.553s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5e974541-de40-4e30-8767-8adfe169baf1 tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:04 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6 Sep 23 12:40:04 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:04 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5e974541-de40-4e30-8767-8adfe169baf1 tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6" returned: 0 in 0.348s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:04 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-5e974541-de40-4e30-8767-8adfe169baf1 tempest-SnapshotsActionsTest-757698842 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6 is being set with open permissions: ugo+rw Sep 23 12:40:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5e974541-de40-4e30-8767-8adfe169baf1 tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:04 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6 Sep 23 12:40:04 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:04 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5e974541-de40-4e30-8767-8adfe169baf1 tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6" returned: 0 in 0.276s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5e974541-de40-4e30-8767-8adfe169baf1 tempest-SnapshotsActionsTest-757698842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.783s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:04 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-5e974541-de40-4e30-8767-8adfe169baf1 tempest-SnapshotsActionsTest-757698842 None] Create snapshot completed successfully Sep 23 12:40:05 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] Acquiring lock "cinder-66f41cb0-2d9b-47f1-b847-ca991df334f6-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:05 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-66f41cb0-2d9b-47f1-b847-ca991df334f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:05 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] Acquiring lock "cinder-quobyte-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:05 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-quobyte-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:05 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] Acquiring lock "cinder-quobyte-66f41cb0-2d9b-47f1-b847-ca991df334f6" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:05 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-quobyte-66f41cb0-2d9b-47f1-b847-ca991df334f6" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] Deleting offline snapshot 66f41cb0-2d9b-47f1-b847-ca991df334f6 of volume f8886f23-b1b8-4c63-abcd-e8f548a4b72d {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:40:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] snapshot_file for this snap is: volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:40:05 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[5655fd7f-3367-4043-b752-d7172f112ea6]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:40:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:05 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6 Sep 23 12:40:05 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:05 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6" returned: 0 in 0.435s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:40:05 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35d47cd-d542-433c-b95a-47fa82663118]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:40:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:05 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd Sep 23 12:40:05 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Flow 'volume_create_manager' (226e07a4-b2ca-4009-93a3-e9dc04142a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f0c198-2355-463f-9f1e-1f4177d580b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:06 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f0c198-2355-463f-9f1e-1f4177d580b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-698458151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff8c4e9-0dec-458b-b0b4-8764d2749f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a038bd400bb94ac4acfacef7aa9a621b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:06Z,use_quota=True,user_id='f06511e7bee7493da7e9ac302a90aacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61795dc9-ceae-4492-880a-0506471a5327),volume_type_id=61795dc9-ceae-4492-880a-0506471a5327)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea24227-e8df-4e01-b7a8-f11839c85961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea24227-e8df-4e01-b7a8-f11839c85961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930a4a2d-9b8c-4210-b64c-08668cec3ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930a4a2d-9b8c-4210-b64c-08668cec3ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ff8c4e9-0dec-458b-b0b4-8764d2749f7d', 'volume_name': 'volume-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d673d75-ed62-4afb-b293-5ca75e1102e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d673d75-ed62-4afb-b293-5ca75e1102e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b8a876-cc88-4b63-88fa-b6f2f7b9f86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:06 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Volume 0ff8c4e9-0dec-458b-b0b4-8764d2749f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d', 'volume_size': 1} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-698458151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff8c4e9-0dec-458b-b0b4-8764d2749f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a038bd400bb94ac4acfacef7aa9a621b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:06Z,use_quota=True,user_id='f06511e7bee7493da7e9ac302a90aacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61795dc9-ceae-4492-880a-0506471a5327),volume_type_id=61795dc9-ceae-4492-880a-0506471a5327)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Creating volume 0ff8c4e9-0dec-458b-b0b4-8764d2749f7d {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:40:06 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd" returned: 0 in 0.580s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:06 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d 1073741824 Sep 23 12:40:06 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:06 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6 Sep 23 12:40:06 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Flow 'volume_create_manager' (b85d9ba0-145b-4692-9e22-586b2f91b533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d945881d-3ad7-4a0e-8a7e-19cb3aba205d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d945881d-3ad7-4a0e-8a7e-19cb3aba205d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2088536838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a08ca6-3966-4cbb-b981-be7355170405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a038bd400bb94ac4acfacef7aa9a621b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:07Z,use_quota=True,user_id='f06511e7bee7493da7e9ac302a90aacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2116542-a448-4c63-9922-943c360b5bab),volume_type_id=a2116542-a448-4c63-9922-943c360b5bab)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25fca889-df3a-480b-bc85-ad7ec1ed2cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25fca889-df3a-480b-bc85-ad7ec1ed2cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacfe71f-6b0d-4845-9340-d0fc992b3145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacfe71f-6b0d-4845-9340-d0fc992b3145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62a08ca6-3966-4cbb-b981-be7355170405', 'volume_name': 'volume-62a08ca6-3966-4cbb-b981-be7355170405', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d4e3d9-dcbb-42da-b344-ce77226c985b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:07 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d4e3d9-dcbb-42da-b344-ce77226c985b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9afafec0-c588-4361-800c-635440dc0975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:07 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Volume 62a08ca6-3966-4cbb-b981-be7355170405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62a08ca6-3966-4cbb-b981-be7355170405', 'volume_size': 1} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d 1073741824" returned: 0 in 0.714s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:07 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6" returned: 0 in 0.745s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:07 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d Sep 23 12:40:07 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:07 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6 Sep 23 12:40:07 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:07 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.66f41cb0-2d9b-47f1-b847-ca991df334f6" returned: 0 in 0.402s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:07 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d" returned: 0 in 0.462s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.519s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2088536838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a08ca6-3966-4cbb-b981-be7355170405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a038bd400bb94ac4acfacef7aa9a621b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:07Z,use_quota=True,user_id='f06511e7bee7493da7e9ac302a90aacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2116542-a448-4c63-9922-943c360b5bab),volume_type_id=a2116542-a448-4c63-9922-943c360b5bab)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Creating volume 62a08ca6-3966-4cbb-b981-be7355170405 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:40:07 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-62a08ca6-3966-4cbb-b981-be7355170405 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-quobyte-66f41cb0-2d9b-47f1-b847-ca991df334f6" released by "_delete_snapshot" :: held 2.366s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-quobyte-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" released by "delete_snapshot" :: held 2.413s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:07 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-62a08ca6-3966-4cbb-b981-be7355170405 1073741824 Sep 23 12:40:07 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b8a876-cc88-4b63-88fa-b6f2f7b9f86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f251a8-f007-4b49-a2b5-5a00e8032b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:07 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Volume volume-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d (0ff8c4e9-0dec-458b-b0b4-8764d2749f7d): created successfully Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f251a8-f007-4b49-a2b5-5a00e8032b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Flow 'volume_create_manager' (226e07a4-b2ca-4009-93a3-e9dc04142a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:07 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d1ecca67-42de-488f-b121-381ddf56b938 tempest-TestInstancesWithCinderVolumes-555387698 None] Created volume successfully. Sep 23 12:40:07 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] Created reservations ['e016307d-ae40-47ec-98bd-6d04d5de2fd7', '138bf6d6-9df8-4b39-9713-b8daeecad260', '9141047b-ca3a-4abd-bd3e-a8cf63da58cd', '371b997f-5cd3-44e1-9eeb-3cce5f652688'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:40:07 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] Delete snapshot completed successfully. Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-08274e3d-113b-478c-8700-1f1ac2911d94 tempest-SnapshotsActionsTest-1651892441 None] Lock "cinder-66f41cb0-2d9b-47f1-b847-ca991df334f6-delete_snapshot" released by "delete_snapshot" :: held 2.765s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Flow 'volume_create_manager' (ed4de9b7-88ee-4019-977f-ef0e366edb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6a20d9-f2e7-4da3-8071-6d20a5c1ffb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6a20d9-f2e7-4da3-8071-6d20a5c1ffb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-168540765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a5a3302-ae32-4d3f-a242-927ebcad3ce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a038bd400bb94ac4acfacef7aa9a621b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:08Z,use_quota=True,user_id='f06511e7bee7493da7e9ac302a90aacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c1807fc-eb15-47cd-b24a-2b63719fa206),volume_type_id=4c1807fc-eb15-47cd-b24a-2b63719fa206)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93327d60-e5dc-46a5-93dd-4292c0107581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93327d60-e5dc-46a5-93dd-4292c0107581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5376440-1607-4721-a1a4-a8d1dda3dc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG cinder.image.glance [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Creating Keystone auth plugin from conf {{(pid=86085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 12:40:08 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-62a08ca6-3966-4cbb-b981-be7355170405 1073741824" returned: 0 in 0.712s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-62a08ca6-3966-4cbb-b981-be7355170405 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:08 devstack sudo[94333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-62a08ca6-3966-4cbb-b981-be7355170405 Sep 23 12:40:08 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5376440-1607-4721-a1a4-a8d1dda3dc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5a5a3302-ae32-4d3f-a242-927ebcad3ce8', 'volume_name': 'volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8', 'volume_size': 1, 'image_id': '3d5c2593-2f66-4536-9c98-283b0e7ed17f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d5c2593-2f66-4536-9c98-283b0e7ed17f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--112931426', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a038bd400bb94ac4acfacef7aa9a621b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d5c2593-2f66-4536-9c98-283b0e7ed17f', 'created_at': datetime.datetime(2026, 9, 23, 10, 40, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 40, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d5c2593-2f66-4536-9c98-283b0e7ed17f/file', 'properties': {}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8042e838-d1ad-4415-9ea5-432cb3c8d203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8042e838-d1ad-4415-9ea5-432cb3c8d203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e0822c-2571-4c65-ba6a-c903a57c90f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:08 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Volume 5a5a3302-ae32-4d3f-a242-927ebcad3ce8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8', 'volume_size': 1, 'image_id': '3d5c2593-2f66-4536-9c98-283b0e7ed17f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d5c2593-2f66-4536-9c98-283b0e7ed17f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--112931426', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a038bd400bb94ac4acfacef7aa9a621b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d5c2593-2f66-4536-9c98-283b0e7ed17f', 'created_at': datetime.datetime(2026, 9, 23, 10, 40, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 40, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d5c2593-2f66-4536-9c98-283b0e7ed17f/file', 'properties': {}}, 'image_service': } Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Trying to clone 5a5a3302-ae32-4d3f-a242-927ebcad3ce8 from image 3d5c2593-2f66-4536-9c98-283b0e7ed17f at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d5c2593-2f66-4536-9c98-283b0e7ed17f', 'metadata': {}}]). {{(pid=86085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 12:40:08 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-62a08ca6-3966-4cbb-b981-be7355170405" returned: 0 in 0.375s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9afafec0-c588-4361-800c-635440dc0975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62a08ca6-3966-4cbb-b981-be7355170405', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041ab502-de56-4ad2-b574-cedda4c6236b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:08 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Volume volume-62a08ca6-3966-4cbb-b981-be7355170405 (62a08ca6-3966-4cbb-b981-be7355170405): created successfully Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041ab502-de56-4ad2-b574-cedda4c6236b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Flow 'volume_create_manager' (b85d9ba0-145b-4692-9e22-586b2f91b533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:08 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-40ea9997-9124-4eeb-9bbf-2a10aea243d9 tempest-TestInstancesWithCinderVolumes-555387698 None] Created volume successfully. Sep 23 12:40:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] Acquiring lock "cinder-0bf5d8a7-7057-44f8-8f9b-daee7f224acd-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] Lock "cinder-0bf5d8a7-7057-44f8-8f9b-daee7f224acd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] Acquiring lock "cinder-quobyte-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] Lock "cinder-quobyte-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] Acquiring lock "cinder-quobyte-0bf5d8a7-7057-44f8-8f9b-daee7f224acd" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] Lock "cinder-quobyte-0bf5d8a7-7057-44f8-8f9b-daee7f224acd" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:09 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] Deleting offline snapshot 0bf5d8a7-7057-44f8-8f9b-daee7f224acd of volume f8886f23-b1b8-4c63-abcd-e8f548a4b72d {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:40:09 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] snapshot_file for this snap is: volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:40:09 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee8a159-3ece-4c24-b672-3ba108453700]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:40:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:09 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd Sep 23 12:40:09 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:09 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd" returned: 0 in 0.663s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:09 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:40:09 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[858035c2-a8d2-4919-aec7-9ae005f74ae7]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:40:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:10 devstack sudo[94365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d Sep 23 12:40:10 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:10 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" returned: 0 in 0.484s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:10 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd Sep 23 12:40:10 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:10 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd" returned: 0 in 0.516s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:11 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd Sep 23 12:40:11 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:11 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d.0bf5d8a7-7057-44f8-8f9b-daee7f224acd" returned: 0 in 0.471s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:11 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:UPDATE=130,cinder:SELECT=107,cinder:DELETE=10,cinder:INSERT=27 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:40:11 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:UPDATE=135,cinder:SELECT=106,cinder:INSERT=34,cinder:DELETE=10 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:40:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] Lock "cinder-quobyte-0bf5d8a7-7057-44f8-8f9b-daee7f224acd" released by "_delete_snapshot" :: held 2.323s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] Lock "cinder-quobyte-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" released by "delete_snapshot" :: held 2.364s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:11 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] Created reservations ['184530ef-c338-42a2-93f0-574aa04235d3', 'bb925582-7292-4cb6-97fc-439404205648', '0fe2058c-14e7-415d-90d8-982e0ba0f6e1', 'c21d1cf2-95d7-46a1-8647-34db575182c6'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:40:11 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] Delete snapshot completed successfully. Sep 23 12:40:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3f14c706-ab80-4eff-98c2-ef6751ed0c4e tempest-SnapshotsActionsTest-757698842 None] Lock "cinder-0bf5d8a7-7057-44f8-8f9b-daee7f224acd-delete_snapshot" released by "delete_snapshot" :: held 2.603s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] Acquiring lock "cinder-f8886f23-b1b8-4c63-abcd-e8f548a4b72d-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] Lock "cinder-f8886f23-b1b8-4c63-abcd-e8f548a4b72d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] Acquiring lock "cinder-quobyte-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] Lock "cinder-quobyte-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" acquired by "delete_volume" :: waited 0.023s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:12 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40ac8f4-6fb2-42c9-94c9-ba98dab8ba0b]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:40:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:12 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d Sep 23 12:40:12 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:13 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" returned: 0 in 0.490s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:13 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d Sep 23 12:40:13 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:13 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" returned: 0 in 0.317s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:13 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] Lock "cinder-quobyte-f8886f23-b1b8-4c63-abcd-e8f548a4b72d" released by "delete_volume" :: held 0.941s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:13 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] Created reservations ['8e9aff86-9bcd-46ef-acd2-2750e60cd284', 'a76aa440-a2a6-4f18-af7e-fb71cf650aa8', 'cd5f8154-05d6-4cf4-9cb5-f603f93e99b6', '92c2dd41-6d7c-462d-8b95-9a2660dabd26'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:40:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:13 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:40:13 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:14 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d5c2593-2f66-4536-9c98-283b0e7ed17f_iwxdd4u9devstack@QuobyteHD, size 20.69 MB, duration 5.44 sec {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 12:40:14 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Image download 20.69 MB at 3.81 MB/s Sep 23 12:40:14 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c397f5a-e0c5-403a-bcd7-d5184061754c]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:40:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d5c2593-2f66-4536-9c98-283b0e7ed17f_iwxdd4u9devstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:14 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.373s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:14 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:40:14 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] Deleted volume successfully. Sep 23 12:40:14 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-10441161-9420-4752-8245-7eab7273d212 tempest-SnapshotsActionsTest-757698842 None] Lock "cinder-f8886f23-b1b8-4c63-abcd-e8f548a4b72d-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:14 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d5c2593-2f66-4536-9c98-283b0e7ed17f_iwxdd4u9devstack@QuobyteHD Sep 23 12:40:14 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:14 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d5c2593-2f66-4536-9c98-283b0e7ed17f_iwxdd4u9devstack@QuobyteHD" returned: 0 in 0.399s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:14 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Temporary image 3d5c2593-2f66-4536-9c98-283b0e7ed17f is fetched for user f06511e7bee7493da7e9ac302a90aacf. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 12:40:14 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdb112f-fa1e-4aae-afa7-c19a9a87060b]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:40:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d5c2593-2f66-4536-9c98-283b0e7ed17f_iwxdd4u9devstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:14 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d5c2593-2f66-4536-9c98-283b0e7ed17f_iwxdd4u9devstack@QuobyteHD Sep 23 12:40:14 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:15 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d5c2593-2f66-4536-9c98-283b0e7ed17f_iwxdd4u9devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-168540765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a5a3302-ae32-4d3f-a242-927ebcad3ce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a038bd400bb94ac4acfacef7aa9a621b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:08Z,use_quota=True,user_id='f06511e7bee7493da7e9ac302a90aacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c1807fc-eb15-47cd-b24a-2b63719fa206),volume_type_id=4c1807fc-eb15-47cd-b24a-2b63719fa206)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:40:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Creating volume 5a5a3302-ae32-4d3f-a242-927ebcad3ce8 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:40:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:40:15 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:40:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:15 devstack sudo[94405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8 1073741824 Sep 23 12:40:15 devstack sudo[94405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:15 devstack sudo[94405]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8 1073741824" returned: 0 in 0.681s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:15 devstack sudo[94410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8 Sep 23 12:40:15 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:16 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8" returned: 0 in 0.260s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:40:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:16 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Attempting download of 3d5c2593-2f66-4536-9c98-283b0e7ed17f ((None, [{'url': 'file:///opt/stack/data/glance/images/3d5c2593-2f66-4536-9c98-283b0e7ed17f', 'metadata': {}}])) to volume 5a5a3302-ae32-4d3f-a242-927ebcad3ce8. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 12:40:16 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[93147799-fd1d-4898-a34b-98d8c22d2694]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:40:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d5c2593-2f66-4536-9c98-283b0e7ed17f_ytx6e6xj {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:16 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d5c2593-2f66-4536-9c98-283b0e7ed17f_ytx6e6xj Sep 23 12:40:16 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:16 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d5c2593-2f66-4536-9c98-283b0e7ed17f_ytx6e6xj" returned: 0 in 0.397s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d5c2593-2f66-4536-9c98-283b0e7ed17f_ytx6e6xj {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:16 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d5c2593-2f66-4536-9c98-283b0e7ed17f_ytx6e6xj Sep 23 12:40:16 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:17 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d5c2593-2f66-4536-9c98-283b0e7ed17f_ytx6e6xj" returned: 1 in 0.436s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d5c2593-2f66-4536-9c98-283b0e7ed17f_ytx6e6xj' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:40:17 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad1238b-bd0b-4f51-9b43-68db8e863427]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:40:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d5c2593-2f66-4536-9c98-283b0e7ed17f_iwxdd4u9devstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:17 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d5c2593-2f66-4536-9c98-283b0e7ed17f_iwxdd4u9devstack@QuobyteHD Sep 23 12:40:17 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:17 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d5c2593-2f66-4536-9c98-283b0e7ed17f_iwxdd4u9devstack@QuobyteHD" returned: 0 in 0.396s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:17 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] 3d5c2593-2f66-4536-9c98-283b0e7ed17f was qcow2, converting to qcow2 {{(pid=86085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 12:40:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d5c2593-2f66-4536-9c98-283b0e7ed17f_iwxdd4u9devstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:17 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d5c2593-2f66-4536-9c98-283b0e7ed17f_iwxdd4u9devstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8 Sep 23 12:40:17 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:20 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d5c2593-2f66-4536-9c98-283b0e7ed17f_iwxdd4u9devstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8" returned: 0 in 3.233s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:20 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d5c2593-2f66-4536-9c98-283b0e7ed17f_iwxdd4u9devstack@QuobyteHD, size 112.00 MB, duration 3.23 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8 {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:40:20 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Converted 112.00 MB image at 34.63 MB/s Sep 23 12:40:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:20 devstack sudo[94452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8 1G Sep 23 12:40:20 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:21 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8 1G" returned: 0 in 0.520s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:21 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Downloaded image 3d5c2593-2f66-4536-9c98-283b0e7ed17f ((None, [{'url': 'file:///opt/stack/data/glance/images/3d5c2593-2f66-4536-9c98-283b0e7ed17f', 'metadata': {}}])) to volume 5a5a3302-ae32-4d3f-a242-927ebcad3ce8 successfully. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 12:40:21 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Temporary image 3d5c2593-2f66-4536-9c98-283b0e7ed17f for user f06511e7bee7493da7e9ac302a90aacf is deleted. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 12:40:21 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Marking volume 5a5a3302-ae32-4d3f-a242-927ebcad3ce8 as bootable. {{(pid=86085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 12:40:21 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Copying metadata from image 3d5c2593-2f66-4536-9c98-283b0e7ed17f to 5a5a3302-ae32-4d3f-a242-927ebcad3ce8. {{(pid=86085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 12:40:21 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Creating volume glance metadata for volume 5a5a3302-ae32-4d3f-a242-927ebcad3ce8 backed by image 3d5c2593-2f66-4536-9c98-283b0e7ed17f with: {'image_id': '3d5c2593-2f66-4536-9c98-283b0e7ed17f', 'image_name': 'tempest-scenario-img--112931426', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 12:40:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e0822c-2571-4c65-ba6a-c903a57c90f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8', 'volume_size': 1, 'image_id': '3d5c2593-2f66-4536-9c98-283b0e7ed17f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d5c2593-2f66-4536-9c98-283b0e7ed17f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--112931426', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a038bd400bb94ac4acfacef7aa9a621b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d5c2593-2f66-4536-9c98-283b0e7ed17f', 'created_at': datetime.datetime(2026, 9, 23, 10, 40, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 40, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d5c2593-2f66-4536-9c98-283b0e7ed17f/file', 'properties': {}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c57ad3-469d-441f-917d-7d4859109724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:21 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Volume volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8 (5a5a3302-ae32-4d3f-a242-927ebcad3ce8): created successfully Sep 23 12:40:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c57ad3-469d-441f-917d-7d4859109724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Flow 'volume_create_manager' (ed4de9b7-88ee-4019-977f-ef0e366edb11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:21 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-6f3597d1-9d64-4e91-b767-e46d2eefcf8a tempest-TestInstancesWithCinderVolumes-555387698 None] Created volume successfully. Sep 23 12:40:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-53f75028-e4d5-491e-ba52-daaa732bb1c3 req-5568380a-d2cc-4fa5-a616-4369626171a4 tempest-TestInstancesWithCinderVolumes-555387698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-53f75028-e4d5-491e-ba52-daaa732bb1c3 req-5568380a-d2cc-4fa5-a616-4369626171a4 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-53f75028-e4d5-491e-ba52-daaa732bb1c3 req-5568380a-d2cc-4fa5-a616-4369626171a4 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-53f75028-e4d5-491e-ba52-daaa732bb1c3 req-5568380a-d2cc-4fa5-a616-4369626171a4 tempest-TestInstancesWithCinderVolumes-555387698 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b9e73e6-58ed-48cf-ba9b-43bb0390d2a5', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:40:27 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-53f75028-e4d5-491e-ba52-daaa732bb1c3 req-5568380a-d2cc-4fa5-a616-4369626171a4 tempest-TestInstancesWithCinderVolumes-555387698 None] attachment_update completed successfully. Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Flow 'volume_create_manager' (98976456-1d9a-4e15-bccd-cbd342744a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f5aff4-1ff5-41f1-b197-f9834faaab44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f5aff4-1ff5-41f1-b197-f9834faaab44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-718658330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e88eb0-adbf-44ab-ac52-8cdc131d7fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff41cfcbc184e54a8acbfa9ccfb7533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:31Z,use_quota=True,user_id='fd632a26548c498ebd6891db7f375569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a6008b-aef6-48e7-b9d1-d791e90050d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a6008b-aef6-48e7-b9d1-d791e90050d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c782ebe5-6599-447c-8c8d-77fefd767854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c782ebe5-6599-447c-8c8d-77fefd767854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e88eb0-adbf-44ab-ac52-8cdc131d7fde', 'volume_name': 'volume-48e88eb0-adbf-44ab-ac52-8cdc131d7fde', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2e5e4f-0c7d-4fe7-8c21-55379209952d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2e5e4f-0c7d-4fe7-8c21-55379209952d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f4fbe6-877d-4632-b161-025023c98730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:31 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Volume 48e88eb0-adbf-44ab-ac52-8cdc131d7fde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e88eb0-adbf-44ab-ac52-8cdc131d7fde', 'volume_size': 1} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-718658330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e88eb0-adbf-44ab-ac52-8cdc131d7fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff41cfcbc184e54a8acbfa9ccfb7533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:31Z,use_quota=True,user_id='fd632a26548c498ebd6891db7f375569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Creating volume 48e88eb0-adbf-44ab-ac52-8cdc131d7fde {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:40:31 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:40:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48e88eb0-adbf-44ab-ac52-8cdc131d7fde 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:31 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48e88eb0-adbf-44ab-ac52-8cdc131d7fde 1073741824 Sep 23 12:40:31 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:32 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48e88eb0-adbf-44ab-ac52-8cdc131d7fde 1073741824" returned: 0 in 0.840s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48e88eb0-adbf-44ab-ac52-8cdc131d7fde {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:32 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48e88eb0-adbf-44ab-ac52-8cdc131d7fde Sep 23 12:40:32 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:32 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48e88eb0-adbf-44ab-ac52-8cdc131d7fde" returned: 0 in 0.729s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:40:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f4fbe6-877d-4632-b161-025023c98730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e88eb0-adbf-44ab-ac52-8cdc131d7fde', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231b9b0b-52ee-40b5-87a5-1d018b3c6e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:33 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Volume volume-48e88eb0-adbf-44ab-ac52-8cdc131d7fde (48e88eb0-adbf-44ab-ac52-8cdc131d7fde): created successfully Sep 23 12:40:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231b9b0b-52ee-40b5-87a5-1d018b3c6e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Flow 'volume_create_manager' (98976456-1d9a-4e15-bccd-cbd342744a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:33 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-86fca290-27e7-42da-adde-43126cc3cf63 tempest-VolumesListAdminTestJSON-1413016518 None] Created volume successfully. Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Flow 'volume_create_manager' (371545b0-7bfe-4926-98c4-651c3ae13cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83748064-a33f-4d71-bb92-f9347acf4c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83748064-a33f-4d71-bb92-f9347acf4c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1722881924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6dae607-1b15-483e-8d77-978d0bbdf4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff41cfcbc184e54a8acbfa9ccfb7533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:34Z,use_quota=True,user_id='fd632a26548c498ebd6891db7f375569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1789c61-4781-4b20-8ab8-a5fa6bae5ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1789c61-4781-4b20-8ab8-a5fa6bae5ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60832558-76b6-446d-b70e-9665bdb68490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60832558-76b6-446d-b70e-9665bdb68490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6dae607-1b15-483e-8d77-978d0bbdf4c9', 'volume_name': 'volume-c6dae607-1b15-483e-8d77-978d0bbdf4c9', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1c7dfd-1a6a-4fba-8aec-138998fc76c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1c7dfd-1a6a-4fba-8aec-138998fc76c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8504a485-0736-4210-89c4-95ba3d801da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:34 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Volume c6dae607-1b15-483e-8d77-978d0bbdf4c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6dae607-1b15-483e-8d77-978d0bbdf4c9', 'volume_size': 1} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1722881924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6dae607-1b15-483e-8d77-978d0bbdf4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff41cfcbc184e54a8acbfa9ccfb7533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:34Z,use_quota=True,user_id='fd632a26548c498ebd6891db7f375569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Creating volume c6dae607-1b15-483e-8d77-978d0bbdf4c9 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:40:34 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:40:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c6dae607-1b15-483e-8d77-978d0bbdf4c9 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:34 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c6dae607-1b15-483e-8d77-978d0bbdf4c9 1073741824 Sep 23 12:40:34 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:35 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c6dae607-1b15-483e-8d77-978d0bbdf4c9 1073741824" returned: 0 in 1.078s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c6dae607-1b15-483e-8d77-978d0bbdf4c9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:35 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c6dae607-1b15-483e-8d77-978d0bbdf4c9 Sep 23 12:40:35 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:36 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c6dae607-1b15-483e-8d77-978d0bbdf4c9" returned: 0 in 0.284s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:40:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8504a485-0736-4210-89c4-95ba3d801da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6dae607-1b15-483e-8d77-978d0bbdf4c9', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7141e598-59a4-463e-bb11-f90adbeeb03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:36 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Volume volume-c6dae607-1b15-483e-8d77-978d0bbdf4c9 (c6dae607-1b15-483e-8d77-978d0bbdf4c9): created successfully Sep 23 12:40:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7141e598-59a4-463e-bb11-f90adbeeb03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Flow 'volume_create_manager' (371545b0-7bfe-4926-98c4-651c3ae13cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:36 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-1c5074d7-e55f-43f2-92d0-8716ef766944 tempest-VolumesListAdminTestJSON-1413016518 None] Created volume successfully. Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Flow 'volume_create_manager' (c09de1fb-4c62-40f1-ad88-2472d544724c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58b9964-d032-4343-a720-85ba69705f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58b9964-d032-4343-a720-85ba69705f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1983141644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27900c28-2232-4fa3-a3d5-84548d0d696b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff41cfcbc184e54a8acbfa9ccfb7533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:38Z,use_quota=True,user_id='fd632a26548c498ebd6891db7f375569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ca3633-975e-4fec-ad9e-e3593e50842c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ca3633-975e-4fec-ad9e-e3593e50842c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1091a2a5-2fe7-4108-ad1a-80d864f1d408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1091a2a5-2fe7-4108-ad1a-80d864f1d408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27900c28-2232-4fa3-a3d5-84548d0d696b', 'volume_name': 'volume-27900c28-2232-4fa3-a3d5-84548d0d696b', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594d38d2-0221-47a3-a71a-df766aca2f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594d38d2-0221-47a3-a71a-df766aca2f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6729b88-9b75-456d-b4b1-8593f2906c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:37 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Volume 27900c28-2232-4fa3-a3d5-84548d0d696b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27900c28-2232-4fa3-a3d5-84548d0d696b', 'volume_size': 1} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1983141644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27900c28-2232-4fa3-a3d5-84548d0d696b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff41cfcbc184e54a8acbfa9ccfb7533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:38Z,use_quota=True,user_id='fd632a26548c498ebd6891db7f375569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Creating volume 27900c28-2232-4fa3-a3d5-84548d0d696b {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:40:37 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:40:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27900c28-2232-4fa3-a3d5-84548d0d696b 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:37 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27900c28-2232-4fa3-a3d5-84548d0d696b 1073741824 Sep 23 12:40:37 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:38 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27900c28-2232-4fa3-a3d5-84548d0d696b 1073741824" returned: 0 in 0.711s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27900c28-2232-4fa3-a3d5-84548d0d696b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:38 devstack sudo[95096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27900c28-2232-4fa3-a3d5-84548d0d696b Sep 23 12:40:38 devstack sudo[95096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:39 devstack sudo[95096]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27900c28-2232-4fa3-a3d5-84548d0d696b" returned: 0 in 0.483s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:40:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6729b88-9b75-456d-b4b1-8593f2906c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27900c28-2232-4fa3-a3d5-84548d0d696b', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c1d970-d908-4235-a67c-59ea30c06fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:39 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Volume volume-27900c28-2232-4fa3-a3d5-84548d0d696b (27900c28-2232-4fa3-a3d5-84548d0d696b): created successfully Sep 23 12:40:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c1d970-d908-4235-a67c-59ea30c06fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Flow 'volume_create_manager' (c09de1fb-4c62-40f1-ad88-2472d544724c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:39 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-bb567792-309c-4920-ad02-03384947bb29 tempest-VolumesListAdminTestJSON-1413016518 None] Created volume successfully. Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Flow 'volume_create_manager' (eb9199cd-a667-4b7b-935a-e7c57284672c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb86a62-a867-4d3c-92e3-2af4dbac892b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb86a62-a867-4d3c-92e3-2af4dbac892b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdec3eba-42f8-428f-8613-b5c3812a7295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='666f6a438f544a20b25289c748b2e0aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:41Z,use_quota=True,user_id='daf29314228a4a9986858c37be4f27f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070e9121-76a1-493e-b4c6-50cc5763bfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070e9121-76a1-493e-b4c6-50cc5763bfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97b43ba-0d17-4f75-ab2a-0e9e1d07063d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97b43ba-0d17-4f75-ab2a-0e9e1d07063d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdec3eba-42f8-428f-8613-b5c3812a7295', 'volume_name': 'volume-fdec3eba-42f8-428f-8613-b5c3812a7295', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0788700-c5ad-4299-8730-4d35738da420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0788700-c5ad-4299-8730-4d35738da420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720ac63d-6605-4dd5-86f1-10e3c344b90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:41 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Volume fdec3eba-42f8-428f-8613-b5c3812a7295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdec3eba-42f8-428f-8613-b5c3812a7295', 'volume_size': 1} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdec3eba-42f8-428f-8613-b5c3812a7295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='666f6a438f544a20b25289c748b2e0aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:41Z,use_quota=True,user_id='daf29314228a4a9986858c37be4f27f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Creating volume fdec3eba-42f8-428f-8613-b5c3812a7295 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:40:41 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdec3eba-42f8-428f-8613-b5c3812a7295 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:41 devstack sudo[95129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdec3eba-42f8-428f-8613-b5c3812a7295 1073741824 Sep 23 12:40:41 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:41 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:40:41 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:42 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.734s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:40:42 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdec3eba-42f8-428f-8613-b5c3812a7295 1073741824" returned: 0 in 0.986s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdec3eba-42f8-428f-8613-b5c3812a7295 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:42 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdec3eba-42f8-428f-8613-b5c3812a7295 Sep 23 12:40:42 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Flow 'volume_create_manager' (2d5496be-fd83-41d4-8b16-3ccfdf00cf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fe6772-c113-4247-81ce-109660826737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fe6772-c113-4247-81ce-109660826737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-842345490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=690b0064-fec8-44e2-80d1-79f485d22411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3616273f487541b6b239b9d68dddd532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:42Z,use_quota=True,user_id='c2e270bb28614df5b58b1cb90fe3374b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0de709-412e-45f5-b829-91277890e899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0de709-412e-45f5-b829-91277890e899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1529fce5-b43d-4456-9869-24e266fcd330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1529fce5-b43d-4456-9869-24e266fcd330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '690b0064-fec8-44e2-80d1-79f485d22411', 'volume_name': 'volume-690b0064-fec8-44e2-80d1-79f485d22411', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f42fb0f3-bc3f-429d-b533-6620eea42aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f42fb0f3-bc3f-429d-b533-6620eea42aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e901701-f965-4c7d-827d-7f5a9a692329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:42 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Volume 690b0064-fec8-44e2-80d1-79f485d22411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-690b0064-fec8-44e2-80d1-79f485d22411', 'volume_size': 1} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:42 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdec3eba-42f8-428f-8613-b5c3812a7295" returned: 0 in 0.425s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.135s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-842345490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=690b0064-fec8-44e2-80d1-79f485d22411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3616273f487541b6b239b9d68dddd532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:42Z,use_quota=True,user_id='c2e270bb28614df5b58b1cb90fe3374b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Creating volume 690b0064-fec8-44e2-80d1-79f485d22411 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:40:42 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-690b0064-fec8-44e2-80d1-79f485d22411 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:42 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-690b0064-fec8-44e2-80d1-79f485d22411 1073741824 Sep 23 12:40:42 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720ac63d-6605-4dd5-86f1-10e3c344b90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdec3eba-42f8-428f-8613-b5c3812a7295', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3481f2e5-59bb-4019-a191-da931a1cc102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:42 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Volume volume-fdec3eba-42f8-428f-8613-b5c3812a7295 (fdec3eba-42f8-428f-8613-b5c3812a7295): created successfully Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3481f2e5-59bb-4019-a191-da931a1cc102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Flow 'volume_create_manager' (eb9199cd-a667-4b7b-935a-e7c57284672c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:42 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d7954a34-f7da-46e1-ac13-f0316fdedbc0 tempest-VolumesListAdminTestJSON-203549746 None] Created volume successfully. Sep 23 12:40:43 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-690b0064-fec8-44e2-80d1-79f485d22411 1073741824" returned: 0 in 0.570s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-690b0064-fec8-44e2-80d1-79f485d22411 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] Acquiring lock "cinder-fdec3eba-42f8-428f-8613-b5c3812a7295-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:43 devstack sudo[95157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-690b0064-fec8-44e2-80d1-79f485d22411 Sep 23 12:40:43 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] Lock "cinder-fdec3eba-42f8-428f-8613-b5c3812a7295-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] Acquiring lock "cinder-quobyte-fdec3eba-42f8-428f-8613-b5c3812a7295" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] Lock "cinder-quobyte-fdec3eba-42f8-428f-8613-b5c3812a7295" acquired by "delete_volume" :: waited 0.048s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] Acquiring lock "cinder-27900c28-2232-4fa3-a3d5-84548d0d696b-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:43 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cabffe-da7b-45fd-8f2f-724d7b154c21]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:40:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdec3eba-42f8-428f-8613-b5c3812a7295 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] Lock "cinder-27900c28-2232-4fa3-a3d5-84548d0d696b-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] Acquiring lock "cinder-quobyte-27900c28-2232-4fa3-a3d5-84548d0d696b" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] Lock "cinder-quobyte-27900c28-2232-4fa3-a3d5-84548d0d696b" acquired by "delete_volume" :: waited 0.029s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:43 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e735fe9e-c176-4cb3-89d7-34dbb6696085]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:40:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27900c28-2232-4fa3-a3d5-84548d0d696b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:43 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-690b0064-fec8-44e2-80d1-79f485d22411" returned: 0 in 0.518s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:40:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:43 devstack sudo[95159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdec3eba-42f8-428f-8613-b5c3812a7295 Sep 23 12:40:43 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e901701-f965-4c7d-827d-7f5a9a692329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-690b0064-fec8-44e2-80d1-79f485d22411', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70ef10f-8b65-405e-8ffc-94431550d28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:44 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Volume volume-690b0064-fec8-44e2-80d1-79f485d22411 (690b0064-fec8-44e2-80d1-79f485d22411): created successfully Sep 23 12:40:44 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70ef10f-8b65-405e-8ffc-94431550d28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:44 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Flow 'volume_create_manager' (2d5496be-fd83-41d4-8b16-3ccfdf00cf9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:44 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-94c90fb6-32d9-4ea9-b40f-9e7a8e44d8c7 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Created volume successfully. Sep 23 12:40:44 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27900c28-2232-4fa3-a3d5-84548d0d696b Sep 23 12:40:44 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:44 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdec3eba-42f8-428f-8613-b5c3812a7295" returned: 0 in 0.549s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdec3eba-42f8-428f-8613-b5c3812a7295 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:44 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdec3eba-42f8-428f-8613-b5c3812a7295 Sep 23 12:40:44 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:44 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27900c28-2232-4fa3-a3d5-84548d0d696b" returned: 0 in 0.641s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27900c28-2232-4fa3-a3d5-84548d0d696b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:44 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27900c28-2232-4fa3-a3d5-84548d0d696b Sep 23 12:40:44 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:44 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdec3eba-42f8-428f-8613-b5c3812a7295" returned: 0 in 0.408s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] Lock "cinder-quobyte-fdec3eba-42f8-428f-8613-b5c3812a7295" released by "delete_volume" :: held 1.057s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:44 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] Created reservations ['4e1657ac-54a1-41fd-b404-a1467b7c761f', 'd65fda61-d27a-4481-96e6-4888325e4927', 'cb63196d-e0bf-4f3d-828b-2b8ac34ae990', 'a10522fd-9cd7-4552-afd2-dc99f4307657'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:40:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Acquiring lock "cinder-690b0064-fec8-44e2-80d1-79f485d22411-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:44 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:44 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Lock "cinder-690b0064-fec8-44e2-80d1-79f485d22411-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:44 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-27900c28-2232-4fa3-a3d5-84548d0d696b" returned: 0 in 0.443s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:45 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:40:45 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] Lock "cinder-quobyte-27900c28-2232-4fa3-a3d5-84548d0d696b" released by "delete_volume" :: held 1.157s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Acquiring lock "cinder-quobyte-690b0064-fec8-44e2-80d1-79f485d22411" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Lock "cinder-quobyte-690b0064-fec8-44e2-80d1-79f485d22411" acquired by "delete_volume" :: waited 0.028s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bb6ad5-00cf-4cdd-8475-6ba1924ab843]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-690b0064-fec8-44e2-80d1-79f485d22411 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] Created reservations ['77c88520-fc10-4b7d-be5e-f78a850834f5', '8eafb3ac-5900-4d1e-acdb-3a8395b73845', 'f5aecce3-c3dd-46b7-8330-822559b0c5ff', 'c6d9c589-0539-4db0-be53-ebb2e539d24f'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:45 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-690b0064-fec8-44e2-80d1-79f485d22411 Sep 23 12:40:45 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:45 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:40:45 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:45 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.456s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:40:45 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] Deleted volume successfully. Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b40658cf-3960-4381-aba2-378e89e5baae tempest-VolumesListAdminTestJSON-203549746 None] Lock "cinder-fdec3eba-42f8-428f-8613-b5c3812a7295-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:45 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-690b0064-fec8-44e2-80d1-79f485d22411" returned: 0 in 0.521s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-690b0064-fec8-44e2-80d1-79f485d22411 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:45 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.384s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:40:45 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] Deleted volume successfully. Sep 23 12:40:45 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-690b0064-fec8-44e2-80d1-79f485d22411 Sep 23 12:40:45 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ed3cd817-d72b-486f-aed6-15a01bb30e7a tempest-VolumesListAdminTestJSON-1413016518 None] Lock "cinder-27900c28-2232-4fa3-a3d5-84548d0d696b-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:45 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-690b0064-fec8-44e2-80d1-79f485d22411" returned: 0 in 0.298s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Lock "cinder-quobyte-690b0064-fec8-44e2-80d1-79f485d22411" released by "delete_volume" :: held 0.876s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:46 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Created reservations ['d3bcbc07-32f8-4b4d-ae9c-2b322a7449f8', '4cd38f35-2916-46f7-9507-1bd6e59b8e05', '4d4a0600-b045-455a-b60d-950790cfdce5', '9959ffe2-3deb-4212-97a4-970a032673ca'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:40:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:46 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:46 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] Acquiring lock "cinder-c6dae607-1b15-483e-8d77-978d0bbdf4c9-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:46 devstack sudo[95191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:40:46 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] Lock "cinder-c6dae607-1b15-483e-8d77-978d0bbdf4c9-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] Acquiring lock "cinder-quobyte-c6dae607-1b15-483e-8d77-978d0bbdf4c9" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] Lock "cinder-quobyte-c6dae607-1b15-483e-8d77-978d0bbdf4c9" acquired by "delete_volume" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:46 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[275be4ea-a5ff-4ea0-b999-329428f17b3a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:40:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c6dae607-1b15-483e-8d77-978d0bbdf4c9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:46 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c6dae607-1b15-483e-8d77-978d0bbdf4c9 Sep 23 12:40:46 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:46 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.546s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:46 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:40:46 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Deleted volume successfully. Sep 23 12:40:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5c994ee9-0981-4164-8b23-6a2b95ab8f32 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Lock "cinder-690b0064-fec8-44e2-80d1-79f485d22411-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:47 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c6dae607-1b15-483e-8d77-978d0bbdf4c9" returned: 0 in 0.569s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c6dae607-1b15-483e-8d77-978d0bbdf4c9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:47 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c6dae607-1b15-483e-8d77-978d0bbdf4c9 Sep 23 12:40:47 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:47 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c6dae607-1b15-483e-8d77-978d0bbdf4c9" returned: 0 in 0.343s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] Lock "cinder-quobyte-c6dae607-1b15-483e-8d77-978d0bbdf4c9" released by "delete_volume" :: held 0.995s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:47 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] Created reservations ['00600659-212d-4b03-bcf9-02f7ee84307f', 'e6d5b33e-3b05-495d-8b00-07e50aa3babf', 'dbcb0c27-8a9f-4aab-a9ba-5583c16708ef', '057e25f4-1918-439d-960c-70d5317773c1'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:40:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:47 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:40:47 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:47 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.324s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:47 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:40:48 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] Deleted volume successfully. Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-62460322-4434-44b2-9ebd-79d22b781d94 tempest-VolumesListAdminTestJSON-1413016518 None] Lock "cinder-c6dae607-1b15-483e-8d77-978d0bbdf4c9-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Flow 'volume_create_manager' (90de27cb-3908-41b6-9e40-62b0688df779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c30749de-e005-4413-8125-8bc71a2ed047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c30749de-e005-4413-8125-8bc71a2ed047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-237355140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3616273f487541b6b239b9d68dddd532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:48Z,use_quota=True,user_id='c2e270bb28614df5b58b1cb90fe3374b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e1efe3-dc37-4435-b27d-704453328eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e1efe3-dc37-4435-b27d-704453328eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b4f23c-6b5a-4dbe-ad91-c6a97d9e7ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b4f23c-6b5a-4dbe-ad91-c6a97d9e7ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b', 'volume_name': 'volume-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90a828ca-56ea-4fc7-9c01-82a0900eedd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90a828ca-56ea-4fc7-9c01-82a0900eedd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47306bc9-af95-48c9-8322-0feb78a4fe25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:48 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Volume 55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b', 'volume_size': 1} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-237355140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3616273f487541b6b239b9d68dddd532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:48Z,use_quota=True,user_id='c2e270bb28614df5b58b1cb90fe3374b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Creating volume 55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:40:48 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:48 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b 1073741824 Sep 23 12:40:48 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] Acquiring lock "cinder-48e88eb0-adbf-44ab-ac52-8cdc131d7fde-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] Lock "cinder-48e88eb0-adbf-44ab-ac52-8cdc131d7fde-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] Acquiring lock "cinder-quobyte-48e88eb0-adbf-44ab-ac52-8cdc131d7fde" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] Lock "cinder-quobyte-48e88eb0-adbf-44ab-ac52-8cdc131d7fde" acquired by "delete_volume" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[51502df4-99fb-4eb1-863c-ac701695d851]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48e88eb0-adbf-44ab-ac52-8cdc131d7fde {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:48 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b 1073741824" returned: 0 in 0.617s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:48 devstack sudo[95211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b Sep 23 12:40:48 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:48 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48e88eb0-adbf-44ab-ac52-8cdc131d7fde Sep 23 12:40:48 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:49 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b" returned: 0 in 0.308s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:40:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47306bc9-af95-48c9-8322-0feb78a4fe25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54afaf0-79cf-4a52-8a93-3f90cef50001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:49 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:49 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Volume volume-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b (55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b): created successfully Sep 23 12:40:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54afaf0-79cf-4a52-8a93-3f90cef50001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Flow 'volume_create_manager' (90de27cb-3908-41b6-9e40-62b0688df779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48e88eb0-adbf-44ab-ac52-8cdc131d7fde" returned: 0 in 0.428s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48e88eb0-adbf-44ab-ac52-8cdc131d7fde {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:49 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-68b1f23a-b306-42b3-9e72-017025ebe3c9 tempest-VolumeQuotasAdminTestJSON-1386345642 None] Created volume successfully. Sep 23 12:40:49 devstack sudo[95219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48e88eb0-adbf-44ab-ac52-8cdc131d7fde Sep 23 12:40:49 devstack sudo[95219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:49 devstack sudo[95219]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48e88eb0-adbf-44ab-ac52-8cdc131d7fde" returned: 0 in 0.255s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:49 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] Lock "cinder-quobyte-48e88eb0-adbf-44ab-ac52-8cdc131d7fde" released by "delete_volume" :: held 0.731s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:49 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] Created reservations ['b4c21fa1-34a8-4b83-b5f0-568e95ce79c8', '3b5c2d5b-9e64-49be-acf5-54b659b519dd', 'c26910db-fb1e-4f07-87b8-c9ec4548e98d', '48be2465-72f0-4556-a7a3-04a59a978ca2'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:40:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:49 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:40:49 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:50 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.407s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:40:50 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] Deleted volume successfully. Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0644fe0c-96a9-4f77-8756-cb1ed089a1de tempest-VolumesListAdminTestJSON-1413016518 None] Lock "cinder-48e88eb0-adbf-44ab-ac52-8cdc131d7fde-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Flow 'volume_create_manager' (7d119366-d0cb-4056-b344-b28f60f49aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d16204-a919-4532-8f6c-6ecf3579c329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d16204-a919-4532-8f6c-6ecf3579c329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1188475557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c11977-2404-4470-ad3d-fbe30b7d8338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a45a4895933f40f08b7ce0eb33e61560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:50Z,use_quota=True,user_id='f43ac7df92c44ebfa0fb9799e624d6b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f18854-ffb6-4183-9dbf-9da4a7e47534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f18854-ffb6-4183-9dbf-9da4a7e47534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb147e9-e0e3-4e5d-b197-830be6ab7298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb147e9-e0e3-4e5d-b197-830be6ab7298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33c11977-2404-4470-ad3d-fbe30b7d8338', 'volume_name': 'volume-33c11977-2404-4470-ad3d-fbe30b7d8338', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9e848c-c9e5-46cc-89f7-0a542eacba71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9e848c-c9e5-46cc-89f7-0a542eacba71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a761a65-c3d1-49f4-822b-7a8573c49515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:50 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Volume 33c11977-2404-4470-ad3d-fbe30b7d8338: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33c11977-2404-4470-ad3d-fbe30b7d8338', 'volume_size': 1} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1188475557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c11977-2404-4470-ad3d-fbe30b7d8338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a45a4895933f40f08b7ce0eb33e61560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:50Z,use_quota=True,user_id='f43ac7df92c44ebfa0fb9799e624d6b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Creating volume 33c11977-2404-4470-ad3d-fbe30b7d8338 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:40:50 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:40:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-33c11977-2404-4470-ad3d-fbe30b7d8338 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:50 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-33c11977-2404-4470-ad3d-fbe30b7d8338 1073741824 Sep 23 12:40:50 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:51 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f43f5ee2-1fa4-4001-999a-581ee37d631d tempest-VolumeQuotasAdminTestJSON-1970949438 None] Transfer volume completed successfully. Sep 23 12:40:51 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-33c11977-2404-4470-ad3d-fbe30b7d8338 1073741824" returned: 0 in 0.691s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-33c11977-2404-4470-ad3d-fbe30b7d8338 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:51 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-33c11977-2404-4470-ad3d-fbe30b7d8338 Sep 23 12:40:51 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:51 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-33c11977-2404-4470-ad3d-fbe30b7d8338" returned: 0 in 0.480s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:40:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a761a65-c3d1-49f4-822b-7a8573c49515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33c11977-2404-4470-ad3d-fbe30b7d8338', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d2851c-e92c-4fd0-8323-39ca40339983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:51 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Volume volume-33c11977-2404-4470-ad3d-fbe30b7d8338 (33c11977-2404-4470-ad3d-fbe30b7d8338): created successfully Sep 23 12:40:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d2851c-e92c-4fd0-8323-39ca40339983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Flow 'volume_create_manager' (7d119366-d0cb-4056-b344-b28f60f49aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:51 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-4b4984ea-344f-41eb-9f11-757401b4ba35 tempest-AttachVolumeTestJSON-539427221 None] Created volume successfully. Sep 23 12:40:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] Acquiring lock "cinder-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] Lock "cinder-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] Acquiring lock "cinder-quobyte-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:40:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] Lock "cinder-quobyte-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b" acquired by "delete_volume" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:40:52 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d6c405-13ae-4d28-a2f3-6ceeffb907fa]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:40:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:52 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b Sep 23 12:40:52 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:52 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b" returned: 0 in 0.464s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:52 devstack sudo[95269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b Sep 23 12:40:52 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:52 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b" returned: 0 in 0.454s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] Lock "cinder-quobyte-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b" released by "delete_volume" :: held 0.993s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:53 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] Created reservations ['22e6f520-55f1-4163-a160-f416006c3b37', 'f0fa94ea-5b4f-4b72-a5ee-4d229d92e4f6', '848c9bda-424e-4c21-97e1-b3752555c61f', 'de5246de-4b05-41d4-8366-4fe4f70642ba'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:40:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:53 devstack sudo[95276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:40:53 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:53 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.376s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:53 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:40:53 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] Deleted volume successfully. Sep 23 12:40:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b1b1237d-0169-4f9b-aacc-69ed7c497a78 tempest-VolumeQuotasAdminTestJSON-1677780011 None] Lock "cinder-55fb4d6a-4b6d-4c4d-82cf-bbc31d948a1b-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:40:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-cf3b8150-1e95-4f06-b654-2c8c857d3589 req-424dfff6-6443-43b4-955b-9c9d7fa722b9 tempest-AttachVolumeTestJSON-539427221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-cf3b8150-1e95-4f06-b654-2c8c857d3589 req-424dfff6-6443-43b4-955b-9c9d7fa722b9 tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-cf3b8150-1e95-4f06-b654-2c8c857d3589 req-424dfff6-6443-43b4-955b-9c9d7fa722b9 tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-cf3b8150-1e95-4f06-b654-2c8c857d3589 req-424dfff6-6443-43b4-955b-9c9d7fa722b9 tempest-AttachVolumeTestJSON-539427221 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-33c11977-2404-4470-ad3d-fbe30b7d8338', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b809aa9f-f1d8-4edf-a098-e46d3e7d52d8', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:40:53 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-cf3b8150-1e95-4f06-b654-2c8c857d3589 req-424dfff6-6443-43b4-955b-9c9d7fa722b9 tempest-AttachVolumeTestJSON-539427221 None] attachment_update completed successfully. Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Flow 'volume_create_manager' (7748e97a-8edd-4a5f-b336-91921b8dd2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c318b5a-5c0f-4bc0-99d6-618ba24d302e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c318b5a-5c0f-4bc0-99d6-618ba24d302e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2139899887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9dfe0c-993b-41f2-9731-4f73817b6efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a45a4895933f40f08b7ce0eb33e61560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:56Z,use_quota=True,user_id='f43ac7df92c44ebfa0fb9799e624d6b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9bd3816-7395-4ee6-b2ae-8f0150a6946c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9bd3816-7395-4ee6-b2ae-8f0150a6946c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71f6c8b-e6bf-4751-b854-4c5596996741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71f6c8b-e6bf-4751-b854-4c5596996741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f9dfe0c-993b-41f2-9731-4f73817b6efb', 'volume_name': 'volume-5f9dfe0c-993b-41f2-9731-4f73817b6efb', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a252c7-abd3-4d53-9b6f-88046eb33b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a252c7-abd3-4d53-9b6f-88046eb33b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa18e8ae-f192-4023-b92e-f67d8603d994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:55 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Volume 5f9dfe0c-993b-41f2-9731-4f73817b6efb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f9dfe0c-993b-41f2-9731-4f73817b6efb', 'volume_size': 1} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2139899887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9dfe0c-993b-41f2-9731-4f73817b6efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a45a4895933f40f08b7ce0eb33e61560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:56Z,use_quota=True,user_id='f43ac7df92c44ebfa0fb9799e624d6b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Creating volume 5f9dfe0c-993b-41f2-9731-4f73817b6efb {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:40:55 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:40:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f9dfe0c-993b-41f2-9731-4f73817b6efb 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:55 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f9dfe0c-993b-41f2-9731-4f73817b6efb 1073741824 Sep 23 12:40:55 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:56 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f9dfe0c-993b-41f2-9731-4f73817b6efb 1073741824" returned: 0 in 0.526s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f9dfe0c-993b-41f2-9731-4f73817b6efb {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:56 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f9dfe0c-993b-41f2-9731-4f73817b6efb Sep 23 12:40:56 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:56 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f9dfe0c-993b-41f2-9731-4f73817b6efb" returned: 0 in 0.400s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:40:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa18e8ae-f192-4023-b92e-f67d8603d994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9dfe0c-993b-41f2-9731-4f73817b6efb', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a9fef2-d6b1-4b21-a6e4-52e928798b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:56 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Volume volume-5f9dfe0c-993b-41f2-9731-4f73817b6efb (5f9dfe0c-993b-41f2-9731-4f73817b6efb): created successfully Sep 23 12:40:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a9fef2-d6b1-4b21-a6e4-52e928798b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Flow 'volume_create_manager' (7748e97a-8edd-4a5f-b336-91921b8dd2d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:56 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-63e2789b-a0be-4013-85f7-54e42fcdea7a tempest-AttachVolumeTestJSON-539427221 None] Created volume successfully. Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Flow 'volume_create_manager' (b688c4e7-71a9-4b91-9557-0091ff51f358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787c799f-0333-4467-ab98-8de49c4358c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787c799f-0333-4467-ab98-8de49c4358c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1302317422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a64c98-d769-45ba-b67b-e665758a8a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b86769432e494c82a16c7deba343fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:57Z,use_quota=True,user_id='9a1519bb18884f1e9a11404d55f1fd5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a5160f8-3698-41e0-b4dd-2a64a6cb25dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a5160f8-3698-41e0-b4dd-2a64a6cb25dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6bc00ac-289a-47ec-85e2-a31a693c2a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6bc00ac-289a-47ec-85e2-a31a693c2a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06a64c98-d769-45ba-b67b-e665758a8a15', 'volume_name': 'volume-06a64c98-d769-45ba-b67b-e665758a8a15', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ecc94da-8165-45a2-bad8-761e892c9154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ecc94da-8165-45a2-bad8-761e892c9154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059655e8-2799-4e19-bc97-9a22904a7a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:57 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Volume 06a64c98-d769-45ba-b67b-e665758a8a15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06a64c98-d769-45ba-b67b-e665758a8a15', 'volume_size': 1} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1302317422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a64c98-d769-45ba-b67b-e665758a8a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b86769432e494c82a16c7deba343fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:40:57Z,use_quota=True,user_id='9a1519bb18884f1e9a11404d55f1fd5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Creating volume 06a64c98-d769-45ba-b67b-e665758a8a15 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:40:57 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:57 devstack sudo[95306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15 1073741824 Sep 23 12:40:57 devstack sudo[95306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:57 devstack sudo[95306]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15 1073741824" returned: 0 in 0.563s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:57 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15 Sep 23 12:40:57 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:40:58 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Sep 23 12:40:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15" returned: 0 in 0.342s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:40:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:40:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059655e8-2799-4e19-bc97-9a22904a7a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06a64c98-d769-45ba-b67b-e665758a8a15', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af4b6fc-2b44-4aac-ae9a-c3482fd7da96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:40:58 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Volume volume-06a64c98-d769-45ba-b67b-e665758a8a15 (06a64c98-d769-45ba-b67b-e665758a8a15): created successfully Sep 23 12:40:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af4b6fc-2b44-4aac-ae9a-c3482fd7da96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:40:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Flow 'volume_create_manager' (b688c4e7-71a9-4b91-9557-0091ff51f358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:40:58 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-fd2e3643-42d5-4a22-a49d-14284ece8440 tempest-VolumesDeleteCascade-707170402 None] Created volume successfully. Sep 23 12:40:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-d5298a41-ed9a-408a-b33b-704a4b0eff39 req-3e541119-1b05-42f2-ba24-83f7d6254796 tempest-AttachVolumeTestJSON-539427221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-d5298a41-ed9a-408a-b33b-704a4b0eff39 req-3e541119-1b05-42f2-ba24-83f7d6254796 tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-d5298a41-ed9a-408a-b33b-704a4b0eff39 req-3e541119-1b05-42f2-ba24-83f7d6254796 tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:40:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-d5298a41-ed9a-408a-b33b-704a4b0eff39 req-3e541119-1b05-42f2-ba24-83f7d6254796 tempest-AttachVolumeTestJSON-539427221 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-5f9dfe0c-993b-41f2-9731-4f73817b6efb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f82846c8-9c90-42d0-8eb4-decf029baef1', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:40:58 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-d5298a41-ed9a-408a-b33b-704a4b0eff39 req-3e541119-1b05-42f2-ba24-83f7d6254796 tempest-AttachVolumeTestJSON-539427221 None] attachment_update completed successfully. Sep 23 12:40:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a611f246-6a53-4071-b006-df760804bc2b tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:40:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a611f246-6a53-4071-b006-df760804bc2b tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:40:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-a611f246-6a53-4071-b006-df760804bc2b tempest-VolumesDeleteCascade-707170402 None] Creating offline snapshot d01948d7-21ea-4c60-81fa-b61d9710b26d of volume 06a64c98-d769-45ba-b67b-e665758a8a15 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:40:59 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a8530d-8ecf-475f-9116-141c41eef1bd]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:40:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a611f246-6a53-4071-b006-df760804bc2b tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:40:59 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15 Sep 23 12:40:59 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:00 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a611f246-6a53-4071-b006-df760804bc2b tempest-VolumesDeleteCascade-707170402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15" returned: 0 in 0.498s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a611f246-6a53-4071-b006-df760804bc2b tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:00 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d 1G Sep 23 12:41:00 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:00 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a611f246-6a53-4071-b006-df760804bc2b tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d 1G" returned: 0 in 0.519s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a611f246-6a53-4071-b006-df760804bc2b tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a64c98-d769-45ba-b67b-e665758a8a15 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:00 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a64c98-d769-45ba-b67b-e665758a8a15 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d Sep 23 12:41:00 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:00 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-ef41e6b0-86ae-41d4-85ca-c63110fe19f3 req-073f396a-768b-45bb-9db0-1f90c9cc3325 tempest-AttachVolumeTestJSON-539427221 None] Terminate volume connection completed successfully. Sep 23 12:41:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-ef41e6b0-86ae-41d4-85ca-c63110fe19f3 req-073f396a-768b-45bb-9db0-1f90c9cc3325 tempest-AttachVolumeTestJSON-539427221 None] Deleting attachment b809aa9f-f1d8-4edf-a098-e46d3e7d52d8. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:41:00 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a611f246-6a53-4071-b006-df760804bc2b tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a64c98-d769-45ba-b67b-e665758a8a15 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d" returned: 0 in 0.373s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:00 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-a611f246-6a53-4071-b006-df760804bc2b tempest-VolumesDeleteCascade-707170402 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d is being set with open permissions: ugo+rw Sep 23 12:41:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a611f246-6a53-4071-b006-df760804bc2b tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:00 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d Sep 23 12:41:00 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:01 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a611f246-6a53-4071-b006-df760804bc2b tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d" returned: 0 in 0.285s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a611f246-6a53-4071-b006-df760804bc2b tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:01 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.info Sep 23 12:41:01 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:01 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a611f246-6a53-4071-b006-df760804bc2b tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.info" returned: 0 in 0.327s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:01 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-a611f246-6a53-4071-b006-df760804bc2b tempest-VolumesDeleteCascade-707170402 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.info is being set with open permissions: ugo+rw Sep 23 12:41:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a611f246-6a53-4071-b006-df760804bc2b tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:01 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.info Sep 23 12:41:01 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:01 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a611f246-6a53-4071-b006-df760804bc2b tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.info" returned: 0 in 0.309s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a611f246-6a53-4071-b006-df760804bc2b tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.431s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:01 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-a611f246-6a53-4071-b006-df760804bc2b tempest-VolumesDeleteCascade-707170402 None] Create snapshot completed successfully Sep 23 12:41:02 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-95d35bb3-5777-4b1f-b5d3-b61c94996aa9 req-f4f8c20b-2da3-478f-acc8-b4a1f76da2a7 tempest-AttachVolumeTestJSON-539427221 None] Terminate volume connection completed successfully. Sep 23 12:41:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-95d35bb3-5777-4b1f-b5d3-b61c94996aa9 req-f4f8c20b-2da3-478f-acc8-b4a1f76da2a7 tempest-AttachVolumeTestJSON-539427221 None] Deleting attachment f82846c8-9c90-42d0-8eb4-decf029baef1. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:41:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1a97985-0008-4e19-89c2-feb9f6851e68 tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1a97985-0008-4e19-89c2-feb9f6851e68 tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d1a97985-0008-4e19-89c2-feb9f6851e68 tempest-VolumesDeleteCascade-707170402 None] Creating offline snapshot dd4999a2-36f9-45cc-bf17-32d51b3c754a of volume 06a64c98-d769-45ba-b67b-e665758a8a15 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:41:02 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e8aead-f07b-4222-b05e-c0998bdedc7e]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1a97985-0008-4e19-89c2-feb9f6851e68 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:03 devstack sudo[95375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d Sep 23 12:41:03 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:03 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1a97985-0008-4e19-89c2-feb9f6851e68 tempest-VolumesDeleteCascade-707170402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d" returned: 0 in 0.506s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d1a97985-0008-4e19-89c2-feb9f6851e68 tempest-VolumesDeleteCascade-707170402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06a64c98-d769-45ba-b67b-e665758a8a15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:41:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1a97985-0008-4e19-89c2-feb9f6851e68 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:03 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a 1G Sep 23 12:41:03 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:04 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1a97985-0008-4e19-89c2-feb9f6851e68 tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a 1G" returned: 0 in 0.660s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1a97985-0008-4e19-89c2-feb9f6851e68 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:04 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a Sep 23 12:41:04 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:04 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1a97985-0008-4e19-89c2-feb9f6851e68 tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a" returned: 0 in 0.535s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:04 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-d1a97985-0008-4e19-89c2-feb9f6851e68 tempest-VolumesDeleteCascade-707170402 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a is being set with open permissions: ugo+rw Sep 23 12:41:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1a97985-0008-4e19-89c2-feb9f6851e68 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:04 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a Sep 23 12:41:04 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:04 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1a97985-0008-4e19-89c2-feb9f6851e68 tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a" returned: 0 in 0.321s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1a97985-0008-4e19-89c2-feb9f6851e68 tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:05 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d1a97985-0008-4e19-89c2-feb9f6851e68 tempest-VolumesDeleteCascade-707170402 None] Create snapshot completed successfully Sep 23 12:41:06 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "cinder-06a64c98-d769-45ba-b67b-e665758a8a15-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:06 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-06a64c98-d769-45ba-b67b-e665758a8a15-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Performing cascade delete. {{(pid=86085) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 23 12:41:06 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "cinder-d01948d7-21ea-4c60-81fa-b61d9710b26d-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:06 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-d01948d7-21ea-4c60-81fa-b61d9710b26d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:06 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "cinder-quobyte-06a64c98-d769-45ba-b67b-e665758a8a15" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:06 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-06a64c98-d769-45ba-b67b-e665758a8a15" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:06 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "cinder-quobyte-d01948d7-21ea-4c60-81fa-b61d9710b26d" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:06 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-d01948d7-21ea-4c60-81fa-b61d9710b26d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:06 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Deleting offline snapshot d01948d7-21ea-4c60-81fa-b61d9710b26d of volume 06a64c98-d769-45ba-b67b-e665758a8a15 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:41:06 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] snapshot_file for this snap is: volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:41:06 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ad9b2c-1ffa-4505-b3b6-fa4e82d15728]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:06 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d Sep 23 12:41:06 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:06 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d" returned: 0 in 0.606s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:06 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06a64c98-d769-45ba-b67b-e665758a8a15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:41:07 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d674a70-fdfe-4921-98ce-58d208ffea67]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:07 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15 Sep 23 12:41:07 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:07 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15" returned: 0 in 0.579s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-10f801c9-91f5-4b16-b361-71fa305911f9 req-2c9e8493-0752-4ff9-be2f-172429051605 tempest-TestInstancesWithCinderVolumes-555387698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-10f801c9-91f5-4b16-b361-71fa305911f9 req-2c9e8493-0752-4ff9-be2f-172429051605 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:07 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6e0932-dc11-4ff0-b876-72b7a419668a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-10f801c9-91f5-4b16-b361-71fa305911f9 req-2c9e8493-0752-4ff9-be2f-172429051605 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-10f801c9-91f5-4b16-b361-71fa305911f9 req-2c9e8493-0752-4ff9-be2f-172429051605 tempest-TestInstancesWithCinderVolumes-555387698 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14643c00-6bf7-4ac1-bc15-afbb21ff02b6', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:41:07 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a Sep 23 12:41:07 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:07 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-10f801c9-91f5-4b16-b361-71fa305911f9 req-2c9e8493-0752-4ff9-be2f-172429051605 tempest-TestInstancesWithCinderVolumes-555387698 None] attachment_update completed successfully. Sep 23 12:41:08 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a" returned: 0 in 0.494s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:08 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06a64c98-d769-45ba-b67b-e665758a8a15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:41:08 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dcf1e4-0b61-4df9-b721-f3de4d90317f]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:08 devstack sudo[95455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d Sep 23 12:41:08 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:08 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d" returned: 0 in 0.487s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:08 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06a64c98-d769-45ba-b67b-e665758a8a15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:41:08 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcfa52f-4a4d-4a94-93d6-2af17f0aea09]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:08 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15 Sep 23 12:41:08 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:09 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15" returned: 0 in 0.415s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] Acquiring lock "cinder-5f9dfe0c-993b-41f2-9731-4f73817b6efb-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:09 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d Sep 23 12:41:09 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] Lock "cinder-5f9dfe0c-993b-41f2-9731-4f73817b6efb-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] Acquiring lock "cinder-quobyte-5f9dfe0c-993b-41f2-9731-4f73817b6efb" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] Lock "cinder-quobyte-5f9dfe0c-993b-41f2-9731-4f73817b6efb" acquired by "delete_volume" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:09 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[48604121-d29d-412c-a13a-bf1aba600f40]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f9dfe0c-993b-41f2-9731-4f73817b6efb {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:09 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f9dfe0c-993b-41f2-9731-4f73817b6efb Sep 23 12:41:09 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:09 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d" returned: 0 in 0.496s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:09 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d Sep 23 12:41:09 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:09 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f9dfe0c-993b-41f2-9731-4f73817b6efb" returned: 0 in 0.469s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f9dfe0c-993b-41f2-9731-4f73817b6efb {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:09 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f9dfe0c-993b-41f2-9731-4f73817b6efb Sep 23 12:41:09 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:09 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.d01948d7-21ea-4c60-81fa-b61d9710b26d" returned: 0 in 0.301s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a64c98-d769-45ba-b67b-e665758a8a15 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a -F qcow2 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:09 devstack sudo[95487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a64c98-d769-45ba-b67b-e665758a8a15 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a -F qcow2 Sep 23 12:41:09 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:10 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f9dfe0c-993b-41f2-9731-4f73817b6efb" returned: 0 in 0.293s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] Lock "cinder-quobyte-5f9dfe0c-993b-41f2-9731-4f73817b6efb" released by "delete_volume" :: held 0.815s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] Created reservations ['3f60d54f-e161-4a6f-aadc-b0f66c44987a', '6675e063-a662-4b46-81f9-ba8efc310dcd', '3cf6146f-47b9-4d2d-a8a1-69db4f12fd8e', '93a35387-bdfd-48ff-8fee-676f18f0622f'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:10 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a64c98-d769-45ba-b67b-e665758a8a15 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a -F qcow2" returned: 0 in 0.382s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:10 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:41:10 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] Acquiring lock "cinder-33c11977-2404-4470-ad3d-fbe30b7d8338-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-d01948d7-21ea-4c60-81fa-b61d9710b26d" released by "_delete_snapshot" :: held 4.030s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] Lock "cinder-33c11977-2404-4470-ad3d-fbe30b7d8338-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-06a64c98-d769-45ba-b67b-e665758a8a15" released by "delete_snapshot" :: held 4.073s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] Acquiring lock "cinder-quobyte-33c11977-2404-4470-ad3d-fbe30b7d8338" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] Lock "cinder-quobyte-33c11977-2404-4470-ad3d-fbe30b7d8338" acquired by "delete_volume" :: waited 0.027s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Created reservations ['73269408-8d7a-4038-8ac7-a01520f55f36', 'c6aeb1e6-ceb0-4281-a8e7-a41e3d4453cc', 'd8e45f2a-0b5f-4d5f-8cda-be77b0978d0a', '87f4f69b-e570-42a7-8514-2ce609c6bfcb'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[259fcc0e-760d-4fa5-8568-7a2bec3a025b]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-33c11977-2404-4470-ad3d-fbe30b7d8338 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:10 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.355s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:41:10 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Delete snapshot completed successfully. Sep 23 12:41:10 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] Deleted volume successfully. Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-d01948d7-21ea-4c60-81fa-b61d9710b26d-delete_snapshot" released by "delete_snapshot" :: held 4.383s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "cinder-dd4999a2-36f9-45cc-bf17-32d51b3c754a-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-dd4999a2-36f9-45cc-bf17-32d51b3c754a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ef4cf0cb-4985-4006-98f3-5bd75b33abcf tempest-AttachVolumeTestJSON-539427221 None] Lock "cinder-5f9dfe0c-993b-41f2-9731-4f73817b6efb-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "cinder-quobyte-06a64c98-d769-45ba-b67b-e665758a8a15" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:10 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-33c11977-2404-4470-ad3d-fbe30b7d8338 Sep 23 12:41:10 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-06a64c98-d769-45ba-b67b-e665758a8a15" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "cinder-quobyte-dd4999a2-36f9-45cc-bf17-32d51b3c754a" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-dd4999a2-36f9-45cc-bf17-32d51b3c754a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Deleting offline snapshot dd4999a2-36f9-45cc-bf17-32d51b3c754a of volume 06a64c98-d769-45ba-b67b-e665758a8a15 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] snapshot_file for this snap is: volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c276c2-3b4e-404a-8008-8451431b62f8]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:10 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a Sep 23 12:41:10 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-09b491a8-51ee-484b-9fba-c7642f624569 req-291102a3-bcfd-4f99-8a5a-4de06280950a tempest-TestInstancesWithCinderVolumes-555387698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-09b491a8-51ee-484b-9fba-c7642f624569 req-291102a3-bcfd-4f99-8a5a-4de06280950a tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-09b491a8-51ee-484b-9fba-c7642f624569 req-291102a3-bcfd-4f99-8a5a-4de06280950a tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:11 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-33c11977-2404-4470-ad3d-fbe30b7d8338" returned: 0 in 0.611s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-33c11977-2404-4470-ad3d-fbe30b7d8338 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-09b491a8-51ee-484b-9fba-c7642f624569 req-291102a3-bcfd-4f99-8a5a-4de06280950a tempest-TestInstancesWithCinderVolumes-555387698 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-62a08ca6-3966-4cbb-b981-be7355170405', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d4841b0-ce35-4151-9670-31157fe7b3a2', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:41:11 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-33c11977-2404-4470-ad3d-fbe30b7d8338 Sep 23 12:41:11 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:11 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-09b491a8-51ee-484b-9fba-c7642f624569 req-291102a3-bcfd-4f99-8a5a-4de06280950a tempest-TestInstancesWithCinderVolumes-555387698 None] attachment_update completed successfully. Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Flow 'volume_create_manager' (c566033b-4faa-4e5b-9c3d-affa184b4596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf075a10-7422-4c73-baf8-143bf4949950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf075a10-7422-4c73-baf8-143bf4949950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1120064995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f06d912-8d86-4e98-b1c9-3c35bbef3a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd961139b4c40c4a7a59401a7e9490b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:41:11Z,use_quota=True,user_id='a52fe0108aaa427dbd21cd12003cf8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58df977-7405-4920-bb79-538479671f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58df977-7405-4920-bb79-538479671f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:11 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a42d88e-a281-4405-a713-816007f8e58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a42d88e-a281-4405-a713-816007f8e58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f06d912-8d86-4e98-b1c9-3c35bbef3a13', 'volume_name': 'volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a50cbb0-8542-4820-9ff7-0301eda6c153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a50cbb0-8542-4820-9ff7-0301eda6c153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e947f1e1-29d0-48eb-9e06-6783d68cab5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:11 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Volume 1f06d912-8d86-4e98-b1c9-3c35bbef3a13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13', 'volume_size': 1} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1120064995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f06d912-8d86-4e98-b1c9-3c35bbef3a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd961139b4c40c4a7a59401a7e9490b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:41:11Z,use_quota=True,user_id='a52fe0108aaa427dbd21cd12003cf8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Creating volume 1f06d912-8d86-4e98-b1c9-3c35bbef3a13 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:41:11 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a" returned: 0 in 0.543s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06a64c98-d769-45ba-b67b-e665758a8a15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:41:11 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13 1073741824 Sep 23 12:41:11 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1ffcaa-7ece-4ada-9afa-8362ce228b71]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:11 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-33c11977-2404-4470-ad3d-fbe30b7d8338" returned: 0 in 0.310s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] Lock "cinder-quobyte-33c11977-2404-4470-ad3d-fbe30b7d8338" released by "delete_volume" :: held 0.991s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] Created reservations ['b0e7a6ff-9a10-4a0c-bd51-5a7f77d7cf87', '11aa6645-261b-47f6-9c51-ff9fa4ac114b', '08bdb5b5-3ede-41cf-adf1-28325655fa54', '147630ee-b39f-46aa-90c9-86e75cb2e8d6'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=134,cinder:INSERT=30,cinder:UPDATE=133,cinder:DELETE=5 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=113,cinder:INSERT=34,cinder:UPDATE=111,cinder:DELETE=15 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:41:11 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15 Sep 23 12:41:11 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:11 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:41:11 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:11 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15" returned: 0 in 0.567s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:12 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a Sep 23 12:41:12 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:12 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13 1073741824" returned: 0 in 0.700s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:12 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.428s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:41:12 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] Deleted volume successfully. Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c93659fa-5738-4a8d-a88f-2d3849297519 tempest-AttachVolumeTestJSON-539427221 None] Lock "cinder-33c11977-2404-4470-ad3d-fbe30b7d8338-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:12 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13 Sep 23 12:41:12 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:12 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a" returned: 0 in 0.354s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:12 devstack sudo[95548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a Sep 23 12:41:12 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:12 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13" returned: 0 in 0.273s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e947f1e1-29d0-48eb-9e06-6783d68cab5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53cc130f-fc28-422b-9989-16bece040070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:12 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Volume volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13 (1f06d912-8d86-4e98-b1c9-3c35bbef3a13): created successfully Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53cc130f-fc28-422b-9989-16bece040070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Flow 'volume_create_manager' (c566033b-4faa-4e5b-9c3d-affa184b4596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:41:12 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-6865633e-38dd-4349-9266-9d05bd49e8e5 tempest-SnapshotMetadataTestJSON-580362154 None] Created volume successfully. Sep 23 12:41:12 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15.dd4999a2-36f9-45cc-bf17-32d51b3c754a" returned: 0 in 0.240s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-dd4999a2-36f9-45cc-bf17-32d51b3c754a" released by "_delete_snapshot" :: held 1.839s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-06a64c98-d769-45ba-b67b-e665758a8a15" released by "delete_snapshot" :: held 1.869s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] Acquiring lock "cinder-e8ab305a-df68-4d6c-9ccb-103a3eeb6899-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] Lock "cinder-e8ab305a-df68-4d6c-9ccb-103a3eeb6899-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Created reservations ['ffc58766-ebc1-43fd-98d4-7a67050a81f6', 'c7a7091a-7e9d-4b40-8435-f253a47260cd', '6d5a8c92-63ef-4088-990e-116fc6c4813e', '9a742342-7831-4055-ae26-149d5b283342'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] Acquiring lock "cinder-quobyte-e8ab305a-df68-4d6c-9ccb-103a3eeb6899" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] Lock "cinder-quobyte-e8ab305a-df68-4d6c-9ccb-103a3eeb6899" acquired by "delete_volume" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:12 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Delete snapshot completed successfully. Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fe0e9d-0804-4b42-b1f4-d4d301bf0496]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e8ab305a-df68-4d6c-9ccb-103a3eeb6899 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-dd4999a2-36f9-45cc-bf17-32d51b3c754a-delete_snapshot" released by "delete_snapshot" :: held 2.112s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Snapshots deleted, issuing volume delete {{(pid=86085) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "cinder-quobyte-06a64c98-d769-45ba-b67b-e665758a8a15" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-06a64c98-d769-45ba-b67b-e665758a8a15" acquired by "delete_volume" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[76474c7b-2805-4bc2-a222-9d6766befc2c]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:12 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e8ab305a-df68-4d6c-9ccb-103a3eeb6899 Sep 23 12:41:12 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:12 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15 Sep 23 12:41:12 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:13 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e8ab305a-df68-4d6c-9ccb-103a3eeb6899" returned: 0 in 0.406s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e8ab305a-df68-4d6c-9ccb-103a3eeb6899 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:13 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e8ab305a-df68-4d6c-9ccb-103a3eeb6899 Sep 23 12:41:13 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:13 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15" returned: 0 in 0.411s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:13 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15 Sep 23 12:41:13 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:13 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e8ab305a-df68-4d6c-9ccb-103a3eeb6899" returned: 0 in 0.305s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] Lock "cinder-quobyte-e8ab305a-df68-4d6c-9ccb-103a3eeb6899" released by "delete_volume" :: held 0.770s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dd3a1650-97d3-4143-aa85-4bf769bd3a38 tempest-SnapshotMetadataTestJSON-580362154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dd3a1650-97d3-4143-aa85-4bf769bd3a38 tempest-SnapshotMetadataTestJSON-580362154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-dd3a1650-97d3-4143-aa85-4bf769bd3a38 tempest-SnapshotMetadataTestJSON-580362154 None] Creating offline snapshot 3da622c1-bfbf-495e-b4cc-2e6dbd7801f9 of volume 1f06d912-8d86-4e98-b1c9-3c35bbef3a13 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:41:13 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-06a64c98-d769-45ba-b67b-e665758a8a15" returned: 0 in 0.325s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[735b656d-b78d-49a7-9156-fce84d8ce43f]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd3a1650-97d3-4143-aa85-4bf769bd3a38 tempest-SnapshotMetadataTestJSON-580362154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-06a64c98-d769-45ba-b67b-e665758a8a15" released by "delete_volume" :: held 0.827s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] Created reservations ['2bf4a6e6-d2c1-4a26-b64c-20e48ffd81ff', '091e8987-0297-451d-b93e-0b61baf68bc3', '3ed1c6ed-312f-481f-957d-61c416f540d1', '67cf17c1-4276-40d8-9814-034f19b0b6ed'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:13 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13 Sep 23 12:41:13 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:13 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Created reservations ['2a018f75-b8ba-4297-9084-962a505c96a0', 'ca5dcac6-a584-45d4-84af-17033f617891', '34189154-7432-40b3-90b2-9d1ae14eb8f8', '44314946-11a2-4085-a112-cf024b6b8e7c'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:41:13 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:13 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:41:13 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:14 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.370s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:14 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:41:14 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] Deleted volume successfully. Sep 23 12:41:14 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0e2f5fd7-7380-4dff-905d-a4e414a939f3 tempest-AttachVolumeTestJSON-539427221 None] Lock "cinder-e8ab305a-df68-4d6c-9ccb-103a3eeb6899-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:14 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd3a1650-97d3-4143-aa85-4bf769bd3a38 tempest-SnapshotMetadataTestJSON-580362154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13" returned: 0 in 0.680s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd3a1650-97d3-4143-aa85-4bf769bd3a38 tempest-SnapshotMetadataTestJSON-580362154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:14 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.380s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:14 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:41:14 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9 1G Sep 23 12:41:14 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:14 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Deleted volume successfully. Sep 23 12:41:14 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07c2d34f-8acd-4735-88d7-3495eba63a53 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-06a64c98-d769-45ba-b67b-e665758a8a15-delete_volume" released by "delete_volume" :: held 8.211s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:14 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd3a1650-97d3-4143-aa85-4bf769bd3a38 tempest-SnapshotMetadataTestJSON-580362154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9 1G" returned: 0 in 0.573s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd3a1650-97d3-4143-aa85-4bf769bd3a38 tempest-SnapshotMetadataTestJSON-580362154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:14 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9 Sep 23 12:41:14 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:15 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:41:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Flow 'volume_create_manager' (a847ae62-46d6-4ed5-8480-319975ba8b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:41:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fa6f13-531d-420b-9d04-fcf9383d77ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fa6f13-531d-420b-9d04-fcf9383d77ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-400893761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb5085c-6536-4187-9ad3-eab000f7ed63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b86769432e494c82a16c7deba343fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:41:15Z,use_quota=True,user_id='9a1519bb18884f1e9a11404d55f1fd5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfae146e-a9c7-492a-b390-3289df08cfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfae146e-a9c7-492a-b390-3289df08cfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da29adff-b77e-4703-8b94-ff84f7a24d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da29adff-b77e-4703-8b94-ff84f7a24d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcb5085c-6536-4187-9ad3-eab000f7ed63', 'volume_name': 'volume-dcb5085c-6536-4187-9ad3-eab000f7ed63', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637b118f-2e31-45d7-b6ac-72f32193f367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:15 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637b118f-2e31-45d7-b6ac-72f32193f367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d73082-0a26-469f-8475-0a6d37106ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:15 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Volume dcb5085c-6536-4187-9ad3-eab000f7ed63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcb5085c-6536-4187-9ad3-eab000f7ed63', 'volume_size': 1} Sep 23 12:41:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd3a1650-97d3-4143-aa85-4bf769bd3a38 tempest-SnapshotMetadataTestJSON-580362154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9" returned: 0 in 0.448s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:15 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-dd3a1650-97d3-4143-aa85-4bf769bd3a38 tempest-SnapshotMetadataTestJSON-580362154 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9 is being set with open permissions: ugo+rw Sep 23 12:41:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd3a1650-97d3-4143-aa85-4bf769bd3a38 tempest-SnapshotMetadataTestJSON-580362154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:15 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9 Sep 23 12:41:15 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:15 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd3a1650-97d3-4143-aa85-4bf769bd3a38 tempest-SnapshotMetadataTestJSON-580362154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9" returned: 0 in 0.259s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd3a1650-97d3-4143-aa85-4bf769bd3a38 tempest-SnapshotMetadataTestJSON-580362154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:15 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.info Sep 23 12:41:15 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:15 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd3a1650-97d3-4143-aa85-4bf769bd3a38 tempest-SnapshotMetadataTestJSON-580362154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.info" returned: 0 in 0.289s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:15 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-dd3a1650-97d3-4143-aa85-4bf769bd3a38 tempest-SnapshotMetadataTestJSON-580362154 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.info is being set with open permissions: ugo+rw Sep 23 12:41:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd3a1650-97d3-4143-aa85-4bf769bd3a38 tempest-SnapshotMetadataTestJSON-580362154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:15 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.info Sep 23 12:41:15 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:16 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd3a1650-97d3-4143-aa85-4bf769bd3a38 tempest-SnapshotMetadataTestJSON-580362154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.info" returned: 0 in 0.292s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dd3a1650-97d3-4143-aa85-4bf769bd3a38 tempest-SnapshotMetadataTestJSON-580362154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.671s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.914s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-400893761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb5085c-6536-4187-9ad3-eab000f7ed63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b86769432e494c82a16c7deba343fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:41:15Z,use_quota=True,user_id='9a1519bb18884f1e9a11404d55f1fd5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:41:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Creating volume dcb5085c-6536-4187-9ad3-eab000f7ed63 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:41:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:41:16 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:41:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:16 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 1073741824 Sep 23 12:41:16 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:16 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-dd3a1650-97d3-4143-aa85-4bf769bd3a38 tempest-SnapshotMetadataTestJSON-580362154 None] Create snapshot completed successfully Sep 23 12:41:16 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 1073741824" returned: 0 in 0.560s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:16 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 Sep 23 12:41:16 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:17 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63" returned: 0 in 0.401s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:41:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d73082-0a26-469f-8475-0a6d37106ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcb5085c-6536-4187-9ad3-eab000f7ed63', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec9d36e-31ad-437d-99ea-b5675c386bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:17 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Volume volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 (dcb5085c-6536-4187-9ad3-eab000f7ed63): created successfully Sep 23 12:41:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec9d36e-31ad-437d-99ea-b5675c386bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Flow 'volume_create_manager' (a847ae62-46d6-4ed5-8480-319975ba8b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:41:17 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-8da0b0d9-cdea-4a68-82ca-d803d7708265 tempest-VolumesDeleteCascade-707170402 None] Created volume successfully. Sep 23 12:41:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] Acquiring lock "cinder-3da622c1-bfbf-495e-b4cc-2e6dbd7801f9-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] Lock "cinder-3da622c1-bfbf-495e-b4cc-2e6dbd7801f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] Acquiring lock "cinder-quobyte-1f06d912-8d86-4e98-b1c9-3c35bbef3a13" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] Lock "cinder-quobyte-1f06d912-8d86-4e98-b1c9-3c35bbef3a13" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] Acquiring lock "cinder-quobyte-3da622c1-bfbf-495e-b4cc-2e6dbd7801f9" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] Lock "cinder-quobyte-3da622c1-bfbf-495e-b4cc-2e6dbd7801f9" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] Deleting offline snapshot 3da622c1-bfbf-495e-b4cc-2e6dbd7801f9 of volume 1f06d912-8d86-4e98-b1c9-3c35bbef3a13 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:41:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] snapshot_file for this snap is: volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:41:17 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-ec496d27-c1f3-4076-b6a0-f6750f57b4f4 req-107de95a-7618-4d54-84a2-3f56456ab639 tempest-TestInstancesWithCinderVolumes-555387698 None] Terminate volume connection completed successfully. Sep 23 12:41:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-ec496d27-c1f3-4076-b6a0-f6750f57b4f4 req-107de95a-7618-4d54-84a2-3f56456ab639 tempest-TestInstancesWithCinderVolumes-555387698 None] Deleting attachment 14643c00-6bf7-4ac1-bc15-afbb21ff02b6. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:41:17 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[410770a5-2442-456c-9542-58a70ea926a4]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:18 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9 Sep 23 12:41:18 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:18 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9" returned: 0 in 0.465s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:41:18 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece346ef-d00c-47de-9048-cb09bd6b8610]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:18 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13 Sep 23 12:41:18 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-90efb9f8-c5ed-4a94-80dd-b3e847b8dcbc tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-90efb9f8-c5ed-4a94-80dd-b3e847b8dcbc tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-90efb9f8-c5ed-4a94-80dd-b3e847b8dcbc tempest-VolumesDeleteCascade-707170402 None] Creating offline snapshot ed392542-bf4c-4bd2-b61a-81a6e3a60906 of volume dcb5085c-6536-4187-9ad3-eab000f7ed63 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:41:18 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[77033d4f-739a-4586-aff2-ded1220f7c23]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-90efb9f8-c5ed-4a94-80dd-b3e847b8dcbc tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] Acquiring lock "cinder-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "cinder-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] Acquiring lock "cinder-quobyte-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "cinder-quobyte-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d" acquired by "delete_volume" :: waited 0.028s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:18 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c262c54d-eab9-420d-a73a-31c40695815b]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:18 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 Sep 23 12:41:18 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:18 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13" returned: 0 in 0.566s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:18 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9 Sep 23 12:41:18 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:19 devstack sudo[95656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d Sep 23 12:41:19 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:19 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-90efb9f8-c5ed-4a94-80dd-b3e847b8dcbc tempest-VolumesDeleteCascade-707170402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63" returned: 0 in 0.748s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-90efb9f8-c5ed-4a94-80dd-b3e847b8dcbc tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:19 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d" returned: 0 in 0.603s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:19 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906 1G Sep 23 12:41:19 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:19 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d Sep 23 12:41:19 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:19 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9" returned: 0 in 0.685s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:19 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9 Sep 23 12:41:19 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:19 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d" returned: 0 in 0.389s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "cinder-quobyte-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d" released by "delete_volume" :: held 1.071s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:19 devstack cinder-volume[86085]: WARNING cinder.quota [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1996895660-929036868 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1996895660-929036868, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:41:19 devstack cinder-volume[86085]: WARNING cinder.quota [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1996895660-929036868 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1996895660-929036868, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:41:19 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] Created reservations ['a12f359e-4237-4cbe-a491-fe6b0242cff1', '24f49562-33cf-4239-901b-f087feadc5b9', 'f4626024-26fe-4fee-98dd-d0eb78ba78bb', '1f2cdd61-afc1-40c2-b5be-0356d1e035b9'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:20 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:41:20 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:20 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13.3da622c1-bfbf-495e-b4cc-2e6dbd7801f9" returned: 0 in 0.509s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:20 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-90efb9f8-c5ed-4a94-80dd-b3e847b8dcbc tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906 1G" returned: 0 in 0.814s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-90efb9f8-c5ed-4a94-80dd-b3e847b8dcbc tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] Lock "cinder-quobyte-3da622c1-bfbf-495e-b4cc-2e6dbd7801f9" released by "_delete_snapshot" :: held 2.376s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] Lock "cinder-quobyte-1f06d912-8d86-4e98-b1c9-3c35bbef3a13" released by "delete_snapshot" :: held 2.421s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:20 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906 Sep 23 12:41:20 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] Created reservations ['70c780e9-75bc-4d72-b19d-4767e3934d11', '448296c9-309a-4d16-9370-05412fec9404', '1675ac67-f841-46f6-8282-bf39ecd78152', '30e559be-55ac-4ab2-9a37-551085d1ddc8'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:41:20 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.327s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:41:20 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] Delete snapshot completed successfully. Sep 23 12:41:20 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] Deleted volume successfully. Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0c79feb4-1773-4b7d-8349-ff16d14e53d6 tempest-SnapshotMetadataTestJSON-580362154 None] Lock "cinder-3da622c1-bfbf-495e-b4cc-2e6dbd7801f9-delete_snapshot" released by "delete_snapshot" :: held 2.620s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fb325b5d-f6ea-41fe-8f31-63908a84ca59 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "cinder-0ff8c4e9-0dec-458b-b0b4-8764d2749f7d-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:20 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-90efb9f8-c5ed-4a94-80dd-b3e847b8dcbc tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906" returned: 0 in 0.379s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:20 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-90efb9f8-c5ed-4a94-80dd-b3e847b8dcbc tempest-VolumesDeleteCascade-707170402 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906 is being set with open permissions: ugo+rw Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-90efb9f8-c5ed-4a94-80dd-b3e847b8dcbc tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:20 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906 Sep 23 12:41:20 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:20 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-90efb9f8-c5ed-4a94-80dd-b3e847b8dcbc tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906" returned: 0 in 0.303s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-90efb9f8-c5ed-4a94-80dd-b3e847b8dcbc tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:20 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.info Sep 23 12:41:20 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] Acquiring lock "cinder-1f06d912-8d86-4e98-b1c9-3c35bbef3a13-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] Lock "cinder-1f06d912-8d86-4e98-b1c9-3c35bbef3a13-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] Acquiring lock "cinder-quobyte-1f06d912-8d86-4e98-b1c9-3c35bbef3a13" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] Lock "cinder-quobyte-1f06d912-8d86-4e98-b1c9-3c35bbef3a13" acquired by "delete_volume" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:21 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-90efb9f8-c5ed-4a94-80dd-b3e847b8dcbc tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.info" returned: 0 in 0.357s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:21 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-90efb9f8-c5ed-4a94-80dd-b3e847b8dcbc tempest-VolumesDeleteCascade-707170402 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.info is being set with open permissions: ugo+rw Sep 23 12:41:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-90efb9f8-c5ed-4a94-80dd-b3e847b8dcbc tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:21 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.info Sep 23 12:41:21 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:21 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f70d56-ddaa-4412-b127-1886d5b001c1]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:21 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13 Sep 23 12:41:21 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:21 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-90efb9f8-c5ed-4a94-80dd-b3e847b8dcbc tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.info" returned: 0 in 0.298s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-90efb9f8-c5ed-4a94-80dd-b3e847b8dcbc tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.039s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:21 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-90efb9f8-c5ed-4a94-80dd-b3e847b8dcbc tempest-VolumesDeleteCascade-707170402 None] Create snapshot completed successfully Sep 23 12:41:21 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13" returned: 0 in 0.484s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:21 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13 Sep 23 12:41:21 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:22 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f06d912-8d86-4e98-b1c9-3c35bbef3a13" returned: 0 in 0.317s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] Lock "cinder-quobyte-1f06d912-8d86-4e98-b1c9-3c35bbef3a13" released by "delete_volume" :: held 0.903s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] Created reservations ['3e3b9a30-c412-4352-9174-54ebd408679d', 'a521e4fe-c5ff-4ae9-b5ed-db5dcfea1c64', '12851f8b-bef6-48e7-8c03-05e7ffe3a38f', '983091bf-8296-4934-ac86-1418b69fa34a'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:22 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:41:22 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Flow 'volume_create_manager' (ba0d38be-250f-4279-b705-0f819b17535d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f27fb7-c03f-448a-aa76-d49da941a90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:22 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.344s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:41:22 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] Deleted volume successfully. Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f27fb7-c03f-448a-aa76-d49da941a90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1998792173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c2ea26-a036-4f4d-a1ec-3136f0a06953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b86769432e494c82a16c7deba343fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ed392542-bf4c-4bd2-b61a-81a6e3a60906,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:41:23Z,use_quota=True,user_id='9a1519bb18884f1e9a11404d55f1fd5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (270707e9-7c47-46a8-894b-15bdab25761d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (270707e9-7c47-46a8-894b-15bdab25761d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94e3e54-e9c3-4d83-91fe-1b28c9c9523f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94e3e54-e9c3-4d83-91fe-1b28c9c9523f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '24c2ea26-a036-4f4d-a1ec-3136f0a06953', 'volume_name': 'volume-24c2ea26-a036-4f4d-a1ec-3136f0a06953', 'volume_size': 1, 'snapshot_id': 'ed392542-bf4c-4bd2-b61a-81a6e3a60906'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0f713a-4bd1-42da-b8a7-1d2211bfb9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0f713a-4bd1-42da-b8a7-1d2211bfb9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7390ca5f-715e-4eca-98a1-dafd4bec89d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:22 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Volume 24c2ea26-a036-4f4d-a1ec-3136f0a06953: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-24c2ea26-a036-4f4d-a1ec-3136f0a06953', 'volume_size': 1, 'snapshot_id': 'ed392542-bf4c-4bd2-b61a-81a6e3a60906'} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "cinder-quobyte-ed392542-bf4c-4bd2-b61a-81a6e3a60906-24c2ea26-a036-4f4d-a1ec-3136f0a06953" by "_create_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3bd55a8b-4f79-4953-9ea0-a3ae9a5d3d25 tempest-SnapshotMetadataTestJSON-580362154 None] Lock "cinder-1f06d912-8d86-4e98-b1c9-3c35bbef3a13-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-ed392542-bf4c-4bd2-b61a-81a6e3a60906-24c2ea26-a036-4f4d-a1ec-3136f0a06953" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Creating volume 24c2ea26-a036-4f4d-a1ec-3136f0a06953 from snapshot ed392542-bf4c-4bd2-b61a-81a6e3a60906 {{(pid=86085) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "cinder-quobyte-24c2ea26-a036-4f4d-a1ec-3136f0a06953" by "_copy_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-24c2ea26-a036-4f4d-a1ec-3136f0a06953" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] snapshot: ed392542-bf4c-4bd2-b61a-81a6e3a60906, volume: 24c2ea26-a036-4f4d-a1ec-3136f0a06953, {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:23 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2828e0a4-af0e-4378-a87d-18a89f461972]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:23 devstack sudo[95737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906 Sep 23 12:41:23 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:23 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906" returned: 0 in 0.523s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcb5085c-6536-4187-9ad3-eab000f7ed63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:41:23 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[026a9f5e-6d57-41ca-91da-e923af40662c]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:23 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-e969f075-b06a-4418-9b87-35d05d47de31 req-0392dbfe-67c0-459a-9601-ec7b46d20a99 tempest-TestInstancesWithCinderVolumes-555387698 None] Terminate volume connection completed successfully. Sep 23 12:41:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-e969f075-b06a-4418-9b87-35d05d47de31 req-0392dbfe-67c0-459a-9601-ec7b46d20a99 tempest-TestInstancesWithCinderVolumes-555387698 None] Deleting attachment 0d4841b0-ce35-4151-9670-31157fe7b3a2. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:41:23 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 Sep 23 12:41:23 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:24 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63" returned: 0 in 0.498s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] will copy from snapshot at /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 12:41:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Creating direct copy from snapshot {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 12:41:24 devstack cinder-volume[86085]: DEBUG cinder.utils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Path /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-24c2ea26-a036-4f4d-a1ec-3136f0a06953 not found in is_blk_device check {{(pid=86085) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 12:41:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-24c2ea26-a036-4f4d-a1ec-3136f0a06953 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:24 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-24c2ea26-a036-4f4d-a1ec-3136f0a06953 Sep 23 12:41:24 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] Acquiring lock "cinder-62a08ca6-3966-4cbb-b981-be7355170405-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "cinder-62a08ca6-3966-4cbb-b981-be7355170405-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] Acquiring lock "cinder-quobyte-62a08ca6-3966-4cbb-b981-be7355170405" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "cinder-quobyte-62a08ca6-3966-4cbb-b981-be7355170405" acquired by "delete_volume" :: waited 0.039s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:24 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[00012d2d-a7c3-47f6-ad0c-35597bab3ddd]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-62a08ca6-3966-4cbb-b981-be7355170405 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:24 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-62a08ca6-3966-4cbb-b981-be7355170405 Sep 23 12:41:24 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:25 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-62a08ca6-3966-4cbb-b981-be7355170405" returned: 0 in 1.082s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-62a08ca6-3966-4cbb-b981-be7355170405 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:25 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-62a08ca6-3966-4cbb-b981-be7355170405 Sep 23 12:41:25 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:26 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-62a08ca6-3966-4cbb-b981-be7355170405" returned: 0 in 0.692s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "cinder-quobyte-62a08ca6-3966-4cbb-b981-be7355170405" released by "delete_volume" :: held 1.883s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:26 devstack cinder-volume[86085]: WARNING cinder.quota [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-319395326-1916437152 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-319395326-1916437152, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:41:26 devstack cinder-volume[86085]: WARNING cinder.quota [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-319395326-1916437152 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-319395326-1916437152, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:41:26 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] Created reservations ['06beb274-090e-4eb5-b9cf-f3f42c7653da', '6a8ba162-984b-4434-adac-b72550781e52', '3a17b0b7-730a-46af-bf12-5103f8ee622c', 'c600d361-1c8d-48bc-8daf-d120bf4796d1'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:41:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:26 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:41:26 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:27 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.781s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:27 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:41:27 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] Deleted volume successfully. Sep 23 12:41:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f58220a6-070c-4439-9c7f-1641340a6e8e tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "cinder-62a08ca6-3966-4cbb-b981-be7355170405-delete_volume" released by "delete_volume" :: held 3.256s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:34 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-24c2ea26-a036-4f4d-a1ec-3136f0a06953" returned: 0 in 10.044s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:34 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Image conversion details: src /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63, size 1024.00 MB, duration 10.04 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-24c2ea26-a036-4f4d-a1ec-3136f0a06953 {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:41:34 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Converted 1024.00 MB image at 101.94 MB/s Sep 23 12:41:34 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-24c2ea26-a036-4f4d-a1ec-3136f0a06953 is being set with open permissions: ugo+rw Sep 23 12:41:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-24c2ea26-a036-4f4d-a1ec-3136f0a06953 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:34 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-24c2ea26-a036-4f4d-a1ec-3136f0a06953 Sep 23 12:41:34 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:34 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-24c2ea26-a036-4f4d-a1ec-3136f0a06953" returned: 0 in 0.434s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-24c2ea26-a036-4f4d-a1ec-3136f0a06953" released by "_copy_volume_from_snapshot" :: held 11.647s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-ed392542-bf4c-4bd2-b61a-81a6e3a60906-24c2ea26-a036-4f4d-a1ec-3136f0a06953" released by "_create_volume_from_snapshot" :: held 11.739s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.762s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7390ca5f-715e-4eca-98a1-dafd4bec89d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c2ea26-a036-4f4d-a1ec-3136f0a06953', 'volume_size': 1, 'snapshot_id': 'ed392542-bf4c-4bd2-b61a-81a6e3a60906'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cfa1b83-1ef2-4239-8805-74540b154b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:34 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Volume volume-24c2ea26-a036-4f4d-a1ec-3136f0a06953 (24c2ea26-a036-4f4d-a1ec-3136f0a06953): created successfully Sep 23 12:41:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cfa1b83-1ef2-4239-8805-74540b154b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Flow 'volume_create_manager' (ba0d38be-250f-4279-b705-0f819b17535d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:41:34 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-07df5d04-669a-4fce-a607-2810dd0c093f tempest-VolumesDeleteCascade-707170402 None] Created volume successfully. Sep 23 12:41:35 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-048fbd10-f72f-4a8d-b898-6be908941fad req-3855ede6-25f5-4931-90bb-cc0c6cf2f946 tempest-TestInstancesWithCinderVolumes-555387698 None] Terminate volume connection completed successfully. Sep 23 12:41:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-048fbd10-f72f-4a8d-b898-6be908941fad req-3855ede6-25f5-4931-90bb-cc0c6cf2f946 tempest-TestInstancesWithCinderVolumes-555387698 None] Deleting attachment 4b9e73e6-58ed-48cf-ba9b-43bb0390d2a5. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:41:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "cinder-dcb5085c-6536-4187-9ad3-eab000f7ed63-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-dcb5085c-6536-4187-9ad3-eab000f7ed63-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Performing cascade delete. {{(pid=86085) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 23 12:41:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "cinder-ed392542-bf4c-4bd2-b61a-81a6e3a60906-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-ed392542-bf4c-4bd2-b61a-81a6e3a60906-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "cinder-quobyte-dcb5085c-6536-4187-9ad3-eab000f7ed63" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-dcb5085c-6536-4187-9ad3-eab000f7ed63" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "cinder-quobyte-ed392542-bf4c-4bd2-b61a-81a6e3a60906" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-ed392542-bf4c-4bd2-b61a-81a6e3a60906" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Deleting offline snapshot ed392542-bf4c-4bd2-b61a-81a6e3a60906 of volume dcb5085c-6536-4187-9ad3-eab000f7ed63 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:41:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] snapshot_file for this snap is: volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:41:35 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef8c47e-d5ba-4659-98ee-303719796937]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:35 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906 Sep 23 12:41:35 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:36 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906" returned: 0 in 0.493s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcb5085c-6536-4187-9ad3-eab000f7ed63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:41:36 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0685b95-cbac-4942-ad89-85b256d45303]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:36 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 Sep 23 12:41:36 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] Acquiring lock "cinder-5a5a3302-ae32-4d3f-a242-927ebcad3ce8-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "cinder-5a5a3302-ae32-4d3f-a242-927ebcad3ce8-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] Acquiring lock "cinder-quobyte-5a5a3302-ae32-4d3f-a242-927ebcad3ce8" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "cinder-quobyte-5a5a3302-ae32-4d3f-a242-927ebcad3ce8" acquired by "delete_volume" :: waited 0.025s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:36 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d7a8dc-d858-4025-b198-b31ac3d4cc4b]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:36 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63" returned: 0 in 0.834s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:37 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906 Sep 23 12:41:37 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:37 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8 Sep 23 12:41:37 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:37 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8" returned: 0 in 0.561s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:37 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8 Sep 23 12:41:37 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:37 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906" returned: 0 in 0.523s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:37 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906 Sep 23 12:41:37 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:37 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5a5a3302-ae32-4d3f-a242-927ebcad3ce8" returned: 0 in 0.460s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "cinder-quobyte-5a5a3302-ae32-4d3f-a242-927ebcad3ce8" released by "delete_volume" :: held 1.092s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:37 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63.ed392542-bf4c-4bd2-b61a-81a6e3a60906" returned: 0 in 0.467s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-ed392542-bf4c-4bd2-b61a-81a6e3a60906" released by "_delete_snapshot" :: held 2.480s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-dcb5085c-6536-4187-9ad3-eab000f7ed63" released by "delete_snapshot" :: held 2.510s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:38 devstack cinder-volume[86085]: WARNING cinder.quota [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1060080546-463366048 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1060080546-463366048, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:41:38 devstack cinder-volume[86085]: WARNING cinder.quota [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1060080546-463366048 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1060080546-463366048, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] Created reservations ['0af9b25c-dab2-4fb1-ab05-3dfb8e3de44d', '86396180-46cd-4767-9f4d-cc5bd7dd1979', 'b948ad2e-79ec-4c95-ad65-aee5bf66b6e4', 'bf3623cd-3061-4dd9-b540-910371b03a72'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Created reservations ['99d7f049-792f-47b1-b25e-86820d4d7214', '76c7ae44-3ac3-420d-9f62-ca4f53913f9a', '4d53bd31-0098-46c1-9833-701e48c484c6', 'abce8b30-2ffe-4e3f-9d87-7ecc8d92b50a'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:38 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:41:38 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:38 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Delete snapshot completed successfully. Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-ed392542-bf4c-4bd2-b61a-81a6e3a60906-delete_snapshot" released by "delete_snapshot" :: held 2.862s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Snapshots deleted, issuing volume delete {{(pid=86085) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "cinder-quobyte-dcb5085c-6536-4187-9ad3-eab000f7ed63" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-dcb5085c-6536-4187-9ad3-eab000f7ed63" acquired by "delete_volume" :: waited 0.028s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff27fe4-59c0-4ec7-ade9-45b3fb916948]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Flow 'volume_create_manager' (ebb9842d-d02b-415b-8878-bf28cb362250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:41:38 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 Sep 23 12:41:38 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b256de4a-4966-401a-aef4-0611ada5cb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b256de4a-4966-401a-aef4-0611ada5cb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-574236722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74512c6f-07ee-4eef-85e6-0c33035c2c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cef9c8da25d44019af40f25a65136750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:41:39Z,use_quota=True,user_id='5d1b9a0785774253b76de69605f5f037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4271fce0-8727-4fd1-9ddb-d4caaf10d0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4271fce0-8727-4fd1-9ddb-d4caaf10d0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f51514-2b6a-4033-ae8a-ee8e27cb4ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f51514-2b6a-4033-ae8a-ee8e27cb4ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74512c6f-07ee-4eef-85e6-0c33035c2c20', 'volume_name': 'volume-74512c6f-07ee-4eef-85e6-0c33035c2c20', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82315cba-23b5-4ff1-a12d-b3a4c1c68137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82315cba-23b5-4ff1-a12d-b3a4c1c68137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e76d17-e19b-43cb-87d5-74cda1ca0263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:38 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Volume 74512c6f-07ee-4eef-85e6-0c33035c2c20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74512c6f-07ee-4eef-85e6-0c33035c2c20', 'volume_size': 1} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-574236722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74512c6f-07ee-4eef-85e6-0c33035c2c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cef9c8da25d44019af40f25a65136750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:41:39Z,use_quota=True,user_id='5d1b9a0785774253b76de69605f5f037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Creating volume 74512c6f-07ee-4eef-85e6-0c33035c2c20 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:41:38 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-74512c6f-07ee-4eef-85e6-0c33035c2c20 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:38 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-74512c6f-07ee-4eef-85e6-0c33035c2c20 1073741824 Sep 23 12:41:38 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:38 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.559s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:41:38 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] Deleted volume successfully. Sep 23 12:41:38 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5880d61d-7f14-4d46-bb20-47a2966de8b8 tempest-TestInstancesWithCinderVolumes-555387698 None] Lock "cinder-5a5a3302-ae32-4d3f-a242-927ebcad3ce8-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:39 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63" returned: 0 in 0.598s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:39 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63 Sep 23 12:41:39 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:39 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dcb5085c-6536-4187-9ad3-eab000f7ed63" returned: 0 in 0.332s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:39 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-dcb5085c-6536-4187-9ad3-eab000f7ed63" released by "delete_volume" :: held 1.031s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:39 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Created reservations ['74935c4b-b3f1-400a-873f-11fd2ef55c1e', '23414b6d-66e7-4765-a66f-887f568c5693', '7f0b286c-549f-49a2-a771-eb9e4c4d8cda', '6949bc02-5c85-4bec-9556-829000abb072'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:41:39 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-74512c6f-07ee-4eef-85e6-0c33035c2c20 1073741824" returned: 0 in 0.799s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-74512c6f-07ee-4eef-85e6-0c33035c2c20 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:39 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-74512c6f-07ee-4eef-85e6-0c33035c2c20 Sep 23 12:41:39 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:39 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:41:39 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:39 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-74512c6f-07ee-4eef-85e6-0c33035c2c20" returned: 0 in 0.368s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:41:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e76d17-e19b-43cb-87d5-74cda1ca0263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74512c6f-07ee-4eef-85e6-0c33035c2c20', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfd8b31-dcdb-4272-8d0a-31e1d2ae562f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:40 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Volume volume-74512c6f-07ee-4eef-85e6-0c33035c2c20 (74512c6f-07ee-4eef-85e6-0c33035c2c20): created successfully Sep 23 12:41:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfd8b31-dcdb-4272-8d0a-31e1d2ae562f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Flow 'volume_create_manager' (ebb9842d-d02b-415b-8878-bf28cb362250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:41:40 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.410s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:40 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:41:40 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ab2f7450-7327-40b8-8dbd-c5c7f6187d49 tempest-AbsoluteLimitsTests-531834738 None] Created volume successfully. Sep 23 12:41:40 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Deleted volume successfully. Sep 23 12:41:40 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c9189b43-d976-4d4a-821f-b4494ace28db tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-dcb5085c-6536-4187-9ad3-eab000f7ed63-delete_volume" released by "delete_volume" :: held 4.759s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:40 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "cinder-24c2ea26-a036-4f4d-a1ec-3136f0a06953-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:40 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-24c2ea26-a036-4f4d-a1ec-3136f0a06953-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:40 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "cinder-quobyte-24c2ea26-a036-4f4d-a1ec-3136f0a06953" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:40 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-24c2ea26-a036-4f4d-a1ec-3136f0a06953" acquired by "delete_volume" :: waited 0.014s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:40 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11bf8a0-ef05-4a8d-9e97-0859a352e9cc]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-24c2ea26-a036-4f4d-a1ec-3136f0a06953 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:40 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-24c2ea26-a036-4f4d-a1ec-3136f0a06953 Sep 23 12:41:40 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:40 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-24c2ea26-a036-4f4d-a1ec-3136f0a06953" returned: 0 in 0.459s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-24c2ea26-a036-4f4d-a1ec-3136f0a06953 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:40 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-24c2ea26-a036-4f4d-a1ec-3136f0a06953 Sep 23 12:41:40 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:40 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] Acquiring lock "cinder-74512c6f-07ee-4eef-85e6-0c33035c2c20-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:40 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] Lock "cinder-74512c6f-07ee-4eef-85e6-0c33035c2c20-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] Acquiring lock "cinder-quobyte-74512c6f-07ee-4eef-85e6-0c33035c2c20" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] Lock "cinder-quobyte-74512c6f-07ee-4eef-85e6-0c33035c2c20" acquired by "delete_volume" :: waited 0.027s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3115ba-3971-4881-a435-ee6e7fdce7c8]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-74512c6f-07ee-4eef-85e6-0c33035c2c20 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:41 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-24c2ea26-a036-4f4d-a1ec-3136f0a06953" returned: 0 in 0.375s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:41 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-74512c6f-07ee-4eef-85e6-0c33035c2c20 Sep 23 12:41:41 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-quobyte-24c2ea26-a036-4f4d-a1ec-3136f0a06953" released by "delete_volume" :: held 0.900s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] Created reservations ['9156ff94-efc8-4f6b-afc5-1c7c52322a6f', '3912e22a-06f9-43ac-8859-47c3fabb1741', '17841184-5ee6-4b0b-8cc2-47ccec1bc85e', '41fd2aa2-8dcb-42d8-a09f-44b72260dd69'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:41 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:41:41 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:41 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:41:41 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:41 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-74512c6f-07ee-4eef-85e6-0c33035c2c20" returned: 0 in 0.604s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-74512c6f-07ee-4eef-85e6-0c33035c2c20 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:41 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-74512c6f-07ee-4eef-85e6-0c33035c2c20 Sep 23 12:41:41 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:41 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.308s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:41:41 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] Deleted volume successfully. Sep 23 12:41:41 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-64077e8d-f64c-417d-a0e6-20f0333c6b87 tempest-VolumesDeleteCascade-707170402 None] Lock "cinder-24c2ea26-a036-4f4d-a1ec-3136f0a06953-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.472s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:41:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:41:42 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-74512c6f-07ee-4eef-85e6-0c33035c2c20" returned: 0 in 0.369s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] Lock "cinder-quobyte-74512c6f-07ee-4eef-85e6-0c33035c2c20" released by "delete_volume" :: held 1.045s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:42 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] Created reservations ['d5e81496-92f9-4ca4-be00-6330e2ded300', '99099969-a965-4636-a648-26e4c725e197', '31b99f1f-380c-4ec9-a445-ab82a0a528d7', '56aacf85-e189-4984-8743-ae737ac9bb2b'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:41:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:42 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:41:42 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:42 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.269s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:42 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:41:42 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] Deleted volume successfully. Sep 23 12:41:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b4752343-8438-4774-aa90-75c5e1d08294 tempest-AbsoluteLimitsTests-531834738 None] Lock "cinder-74512c6f-07ee-4eef-85e6-0c33035c2c20-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Flow 'volume_create_manager' (595ff3a4-7b4e-4be9-8cc3-7ed27c298012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d105a8d8-bb20-47df-8eca-fc95bca0e69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d105a8d8-bb20-47df-8eca-fc95bca0e69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1305298160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dabc98b-6b2f-49c1-bac7-0d87090c3d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec73238bf41c42af832519cc18be573c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:41:52Z,use_quota=True,user_id='855ff6754904409dbd8281d94bdb8a54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0d7069-46a7-4690-b744-b0fd0251b9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0d7069-46a7-4690-b744-b0fd0251b9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52de2025-e56b-4b33-ab18-2dad3b8e7cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52de2025-e56b-4b33-ab18-2dad3b8e7cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dabc98b-6b2f-49c1-bac7-0d87090c3d36', 'volume_name': 'volume-7dabc98b-6b2f-49c1-bac7-0d87090c3d36', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5bd39ee-6b49-4674-97c6-0f2eae2337ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5bd39ee-6b49-4674-97c6-0f2eae2337ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019927e9-8195-4593-96dd-c7fe783ae018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:51 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Volume 7dabc98b-6b2f-49c1-bac7-0d87090c3d36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dabc98b-6b2f-49c1-bac7-0d87090c3d36', 'volume_size': 1} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1305298160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dabc98b-6b2f-49c1-bac7-0d87090c3d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec73238bf41c42af832519cc18be573c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:41:52Z,use_quota=True,user_id='855ff6754904409dbd8281d94bdb8a54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Creating volume 7dabc98b-6b2f-49c1-bac7-0d87090c3d36 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:41:51 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:41:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7dabc98b-6b2f-49c1-bac7-0d87090c3d36 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:51 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7dabc98b-6b2f-49c1-bac7-0d87090c3d36 1073741824 Sep 23 12:41:51 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:52 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7dabc98b-6b2f-49c1-bac7-0d87090c3d36 1073741824" returned: 0 in 0.577s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7dabc98b-6b2f-49c1-bac7-0d87090c3d36 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:52 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7dabc98b-6b2f-49c1-bac7-0d87090c3d36 Sep 23 12:41:52 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:52 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7dabc98b-6b2f-49c1-bac7-0d87090c3d36" returned: 0 in 0.295s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:41:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019927e9-8195-4593-96dd-c7fe783ae018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dabc98b-6b2f-49c1-bac7-0d87090c3d36', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d66dc0-d305-4deb-b060-6e6bd055be5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:52 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Volume volume-7dabc98b-6b2f-49c1-bac7-0d87090c3d36 (7dabc98b-6b2f-49c1-bac7-0d87090c3d36): created successfully Sep 23 12:41:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d66dc0-d305-4deb-b060-6e6bd055be5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Flow 'volume_create_manager' (595ff3a4-7b4e-4be9-8cc3-7ed27c298012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:41:52 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0c68a009-aea9-47e5-b3a1-9bf5e7fa5255 tempest-VolumesTransfersTest-692243113 None] Created volume successfully. Sep 23 12:41:54 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-51ae6cac-a9a3-428a-8067-8a56f7a33cfd tempest-VolumesTransfersTest-1988293530 None] Transfer volume completed successfully. Sep 23 12:41:55 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] Acquiring lock "cinder-7dabc98b-6b2f-49c1-bac7-0d87090c3d36-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:55 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] Lock "cinder-7dabc98b-6b2f-49c1-bac7-0d87090c3d36-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:55 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] Acquiring lock "cinder-quobyte-7dabc98b-6b2f-49c1-bac7-0d87090c3d36" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:41:55 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] Lock "cinder-quobyte-7dabc98b-6b2f-49c1-bac7-0d87090c3d36" acquired by "delete_volume" :: waited 0.024s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:41:55 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd462fb1-857e-4fdc-b388-b240ae9b3efc]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:41:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7dabc98b-6b2f-49c1-bac7-0d87090c3d36 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:56 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7dabc98b-6b2f-49c1-bac7-0d87090c3d36 Sep 23 12:41:56 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:56 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7dabc98b-6b2f-49c1-bac7-0d87090c3d36" returned: 0 in 0.752s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7dabc98b-6b2f-49c1-bac7-0d87090c3d36 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:56 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7dabc98b-6b2f-49c1-bac7-0d87090c3d36 Sep 23 12:41:56 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:57 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7dabc98b-6b2f-49c1-bac7-0d87090c3d36" returned: 0 in 0.539s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] Lock "cinder-quobyte-7dabc98b-6b2f-49c1-bac7-0d87090c3d36" released by "delete_volume" :: held 1.392s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:57 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] Created reservations ['9158cbfa-3cf2-4a9d-91f1-d69423a5f93a', '8a798f0a-6828-4387-8df4-1e0978ea1b76', 'ac702542-2d80-498a-9bee-b7d315036085', 'c046ab8b-17e5-44a3-a6f0-f5a5ac6deee6'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:41:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:57 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:41:57 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:41:58 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Sep 23 12:41:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.709s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:41:58 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:41:58 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] Deleted volume successfully. Sep 23 12:41:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1e0cb13b-a0b1-4cf5-bfb9-e67a32b5c87c tempest-VolumesTransfersTest-1772710273 None] Lock "cinder-7dabc98b-6b2f-49c1-bac7-0d87090c3d36-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Flow 'volume_create_manager' (2b95fbab-cae2-42d3-8676-6f2da218e641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9ee795-51a8-49cc-aef3-35bc57385f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9ee795-51a8-49cc-aef3-35bc57385f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-431062165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9045b8-ac51-4d99-b900-17063afa98c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec73238bf41c42af832519cc18be573c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:41:59Z,use_quota=True,user_id='855ff6754904409dbd8281d94bdb8a54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0409c8a2-dd37-483e-bcb0-c82520d6abb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0409c8a2-dd37-483e-bcb0-c82520d6abb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26bba49f-8dec-4172-a164-93503c60455d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26bba49f-8dec-4172-a164-93503c60455d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d9045b8-ac51-4d99-b900-17063afa98c4', 'volume_name': 'volume-9d9045b8-ac51-4d99-b900-17063afa98c4', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f8415e-531f-4ac3-ba92-b84e99e66da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f8415e-531f-4ac3-ba92-b84e99e66da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619bedf4-d8f0-4535-ab34-befabf1b66c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:41:59 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Volume 9d9045b8-ac51-4d99-b900-17063afa98c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d9045b8-ac51-4d99-b900-17063afa98c4', 'volume_size': 1} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-431062165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9045b8-ac51-4d99-b900-17063afa98c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec73238bf41c42af832519cc18be573c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:41:59Z,use_quota=True,user_id='855ff6754904409dbd8281d94bdb8a54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Creating volume 9d9045b8-ac51-4d99-b900-17063afa98c4 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:41:59 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:41:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d9045b8-ac51-4d99-b900-17063afa98c4 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:41:59 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d9045b8-ac51-4d99-b900-17063afa98c4 1073741824 Sep 23 12:41:59 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:00 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d9045b8-ac51-4d99-b900-17063afa98c4 1073741824" returned: 0 in 0.794s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d9045b8-ac51-4d99-b900-17063afa98c4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:00 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d9045b8-ac51-4d99-b900-17063afa98c4 Sep 23 12:42:00 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:00 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d9045b8-ac51-4d99-b900-17063afa98c4" returned: 0 in 0.555s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:42:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:42:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619bedf4-d8f0-4535-ab34-befabf1b66c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d9045b8-ac51-4d99-b900-17063afa98c4', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ea9fe9-df9f-46fb-afa9-3f62c42958f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:00 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Volume volume-9d9045b8-ac51-4d99-b900-17063afa98c4 (9d9045b8-ac51-4d99-b900-17063afa98c4): created successfully Sep 23 12:42:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ea9fe9-df9f-46fb-afa9-3f62c42958f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Flow 'volume_create_manager' (2b95fbab-cae2-42d3-8676-6f2da218e641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:42:01 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-4f7b81d9-7355-4ef0-a7e4-2e7b74496c56 tempest-VolumesTransfersTest-692243113 None] Created volume successfully. Sep 23 12:42:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] Acquiring lock "cinder-9d9045b8-ac51-4d99-b900-17063afa98c4-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:42:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] Lock "cinder-9d9045b8-ac51-4d99-b900-17063afa98c4-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:42:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] Acquiring lock "cinder-quobyte-9d9045b8-ac51-4d99-b900-17063afa98c4" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:42:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] Lock "cinder-quobyte-9d9045b8-ac51-4d99-b900-17063afa98c4" acquired by "delete_volume" :: waited 0.026s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6b0814-ce28-4899-a194-d5a77fef9a74]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d9045b8-ac51-4d99-b900-17063afa98c4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Flow 'volume_create_manager' (a07874b4-1be8-4aa1-9fe2-98ecec68e3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8cd921-1e54-4434-84bc-8a457be82b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8cd921-1e54-4434-84bc-8a457be82b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1623271444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5612bfc-1399-4bc6-9dcd-181a83061ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af66be7b205c49829384c5c548c2fe05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:42:02Z,use_quota=True,user_id='13e06ccd64454a7d9494b7d1c032d22b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ae5881-baaf-4173-b3d0-26330f36a333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ae5881-baaf-4173-b3d0-26330f36a333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db99bcb6-4a30-4ea5-a586-7a5cf2b7c543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db99bcb6-4a30-4ea5-a586-7a5cf2b7c543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5612bfc-1399-4bc6-9dcd-181a83061ab0', 'volume_name': 'volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464e1a63-f728-497d-a484-41868e2caf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464e1a63-f728-497d-a484-41868e2caf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923de88c-a628-44cb-b95d-bb535bf8ba3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:02 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Volume b5612bfc-1399-4bc6-9dcd-181a83061ab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0', 'volume_size': 1} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1623271444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5612bfc-1399-4bc6-9dcd-181a83061ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af66be7b205c49829384c5c548c2fe05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:42:02Z,use_quota=True,user_id='13e06ccd64454a7d9494b7d1c032d22b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Creating volume b5612bfc-1399-4bc6-9dcd-181a83061ab0 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:42:02 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:02 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 1073741824 Sep 23 12:42:02 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:02 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d9045b8-ac51-4d99-b900-17063afa98c4 Sep 23 12:42:02 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:02 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d9045b8-ac51-4d99-b900-17063afa98c4" returned: 0 in 0.602s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d9045b8-ac51-4d99-b900-17063afa98c4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:02 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d9045b8-ac51-4d99-b900-17063afa98c4 Sep 23 12:42:02 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:02 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 1073741824" returned: 0 in 0.812s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:03 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:03 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 Sep 23 12:42:03 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d9045b8-ac51-4d99-b900-17063afa98c4" returned: 0 in 0.531s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] Lock "cinder-quobyte-9d9045b8-ac51-4d99-b900-17063afa98c4" released by "delete_volume" :: held 1.274s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] Created reservations ['ea46aad0-4f93-42db-85eb-073e4b3b335c', 'b3739821-7332-4415-9f41-a361a8fa793e', '37ddc16c-15a8-4bc4-a625-b2bc58e2a96f', '51d6c049-e28c-4bd5-978c-e21f1ddc4a86'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:03 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:42:03 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:03 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0" returned: 0 in 0.582s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923de88c-a628-44cb-b95d-bb535bf8ba3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8b9836-2b20-41b5-b4fc-51e8d12c1275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:03 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Volume volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 (b5612bfc-1399-4bc6-9dcd-181a83061ab0): created successfully Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8b9836-2b20-41b5-b4fc-51e8d12c1275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Flow 'volume_create_manager' (a07874b4-1be8-4aa1-9fe2-98ecec68e3f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:42:03 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-231523fc-1d95-404e-a96c-82ef58f43b2e tempest-VolumesActionsTest-1116303169 None] Created volume successfully. Sep 23 12:42:03 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.423s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:42:03 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] Deleted volume successfully. Sep 23 12:42:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1058d43e-0067-4de3-a6f9-1f9f1a52ecc4 tempest-VolumesTransfersTest-1772710273 None] Lock "cinder-9d9045b8-ac51-4d99-b900-17063afa98c4-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:42:13 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:UPDATE=120,cinder:SELECT=86,cinder:INSERT=41,cinder:DELETE=10 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:42:13 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:UPDATE=142,cinder:DELETE=11,cinder:SELECT=103,cinder:INSERT=24 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:42:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ee73e5b1-aa1c-48f3-8001-38d3febc85ed tempest-VolumesActionsTest-1116303169 None] Acquiring lock "cinder-b5612bfc-1399-4bc6-9dcd-181a83061ab0" by "attach_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:42:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ee73e5b1-aa1c-48f3-8001-38d3febc85ed tempest-VolumesActionsTest-1116303169 None] Lock "cinder-b5612bfc-1399-4bc6-9dcd-181a83061ab0" acquired by "attach_volume" :: waited 0.038s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:42:18 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ee73e5b1-aa1c-48f3-8001-38d3febc85ed tempest-VolumesActionsTest-1116303169 None] Attaching volume b5612bfc-1399-4bc6-9dcd-181a83061ab0 to instance a789054c-c7da-42d0-aa40-9cfca512dcaf at mountpoint /dev/vdb on host None. Sep 23 12:42:18 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ee73e5b1-aa1c-48f3-8001-38d3febc85ed tempest-VolumesActionsTest-1116303169 None] Attach volume completed successfully. Sep 23 12:42:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ee73e5b1-aa1c-48f3-8001-38d3febc85ed tempest-VolumesActionsTest-1116303169 None] Lock "cinder-b5612bfc-1399-4bc6-9dcd-181a83061ab0" released by "attach_volume" :: held 0.223s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:42:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-29951d1e-9965-4bfc-b877-3b2c8a18c40e tempest-VolumesActionsTest-1116303169 None] Acquiring lock "cinder-b5612bfc-1399-4bc6-9dcd-181a83061ab0-detach_volume" by "detach_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:42:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-29951d1e-9965-4bfc-b877-3b2c8a18c40e tempest-VolumesActionsTest-1116303169 None] Lock "cinder-b5612bfc-1399-4bc6-9dcd-181a83061ab0-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:42:18 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-29951d1e-9965-4bfc-b877-3b2c8a18c40e tempest-VolumesActionsTest-1116303169 None] Detaching volume b5612bfc-1399-4bc6-9dcd-181a83061ab0 from instance a789054c-c7da-42d0-aa40-9cfca512dcaf. Sep 23 12:42:19 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-29951d1e-9965-4bfc-b877-3b2c8a18c40e tempest-VolumesActionsTest-1116303169 None] Detach volume completed successfully. Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-29951d1e-9965-4bfc-b877-3b2c8a18c40e tempest-VolumesActionsTest-1116303169 None] Lock "cinder-b5612bfc-1399-4bc6-9dcd-181a83061ab0-detach_volume" released by "detach_volume" :: held 0.156s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Flow 'volume_create_manager' (ea7878d7-5414-4328-ac7d-15e53159cd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e72c843-7830-4b6e-957b-8733e495007d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e72c843-7830-4b6e-957b-8733e495007d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-153172679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c6b39b-dfc2-4652-a551-4b37f5c62f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0559227864be4bd09621397be023b5f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:42:19Z,use_quota=True,user_id='419be06d6c7c4459a1d8db782333426e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1324f796-613e-4375-8721-7a3493c7ccdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1324f796-613e-4375-8721-7a3493c7ccdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e385565b-006d-42d0-a079-6b21b758c325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e385565b-006d-42d0-a079-6b21b758c325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02c6b39b-dfc2-4652-a551-4b37f5c62f18', 'volume_name': 'volume-02c6b39b-dfc2-4652-a551-4b37f5c62f18', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd411bf6-ebfd-4a34-ba08-01ab08752fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd411bf6-ebfd-4a34-ba08-01ab08752fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140f1998-8d77-42c7-854f-ff1a552ce64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:19 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Volume 02c6b39b-dfc2-4652-a551-4b37f5c62f18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02c6b39b-dfc2-4652-a551-4b37f5c62f18', 'volume_size': 1} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-153172679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c6b39b-dfc2-4652-a551-4b37f5c62f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0559227864be4bd09621397be023b5f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:42:19Z,use_quota=True,user_id='419be06d6c7c4459a1d8db782333426e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Creating volume 02c6b39b-dfc2-4652-a551-4b37f5c62f18 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:42:19 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:42:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-02c6b39b-dfc2-4652-a551-4b37f5c62f18 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:19 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-02c6b39b-dfc2-4652-a551-4b37f5c62f18 1073741824 Sep 23 12:42:19 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:20 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-02c6b39b-dfc2-4652-a551-4b37f5c62f18 1073741824" returned: 0 in 0.897s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-02c6b39b-dfc2-4652-a551-4b37f5c62f18 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:20 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-02c6b39b-dfc2-4652-a551-4b37f5c62f18 Sep 23 12:42:20 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:21 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-02c6b39b-dfc2-4652-a551-4b37f5c62f18" returned: 0 in 0.425s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:42:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:42:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140f1998-8d77-42c7-854f-ff1a552ce64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02c6b39b-dfc2-4652-a551-4b37f5c62f18', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6903e6b-7258-41f8-9ba9-dc07f49e972a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:21 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Volume volume-02c6b39b-dfc2-4652-a551-4b37f5c62f18 (02c6b39b-dfc2-4652-a551-4b37f5c62f18): created successfully Sep 23 12:42:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6903e6b-7258-41f8-9ba9-dc07f49e972a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Flow 'volume_create_manager' (ea7878d7-5414-4328-ac7d-15e53159cd04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:42:21 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-4a46afd5-bd3f-4ad8-aa21-b078b818c3d2 tempest-VolumesTransfersV355Test-831516984 None] Created volume successfully. Sep 23 12:42:22 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-7673b948-b3ef-465e-a3e6-6faf83fb3394 tempest-VolumesTransfersV355Test-1941485163 None] Transfer volume completed successfully. Sep 23 12:42:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] Acquiring lock "cinder-02c6b39b-dfc2-4652-a551-4b37f5c62f18-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:42:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] Lock "cinder-02c6b39b-dfc2-4652-a551-4b37f5c62f18-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:42:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] Acquiring lock "cinder-quobyte-02c6b39b-dfc2-4652-a551-4b37f5c62f18" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:42:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] Lock "cinder-quobyte-02c6b39b-dfc2-4652-a551-4b37f5c62f18" acquired by "delete_volume" :: waited 0.035s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:42:23 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9999d1b-cb5d-44d7-93ae-747e77aee0f5]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:42:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-02c6b39b-dfc2-4652-a551-4b37f5c62f18 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:23 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-02c6b39b-dfc2-4652-a551-4b37f5c62f18 Sep 23 12:42:23 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:23 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-02c6b39b-dfc2-4652-a551-4b37f5c62f18" returned: 0 in 0.445s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-02c6b39b-dfc2-4652-a551-4b37f5c62f18 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:24 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-02c6b39b-dfc2-4652-a551-4b37f5c62f18 Sep 23 12:42:24 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:24 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-02c6b39b-dfc2-4652-a551-4b37f5c62f18" returned: 0 in 0.324s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] Lock "cinder-quobyte-02c6b39b-dfc2-4652-a551-4b37f5c62f18" released by "delete_volume" :: held 0.827s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:42:24 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] Created reservations ['57ce1f8d-3ab8-4b32-8a7f-1656fbe2f68f', 'b80b703e-a094-4be9-9b35-69c6aa5445f2', 'a68ac101-5096-4698-b067-9b17f43cb979', '60e16d37-d7b1-4f75-85e9-47759538b2d8'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:42:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:42:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:42:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:42:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:42:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:42:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:24 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:42:24 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:24 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.430s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:24 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:42:24 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] Deleted volume successfully. Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8f3dfc68-695d-4b2f-a0ef-b1ec57087e92 tempest-VolumesTransfersV355Test-1665527778 None] Lock "cinder-02c6b39b-dfc2-4652-a551-4b37f5c62f18-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Flow 'volume_create_manager' (fddd72a6-3f6a-4be9-a9fa-8d03b743d675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b29d495-1a7f-485d-93f0-92fcb33be9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b29d495-1a7f-485d-93f0-92fcb33be9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-824360338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e285c58-504f-4ad3-a248-60ca79c2ddd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0559227864be4bd09621397be023b5f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:42:25Z,use_quota=True,user_id='419be06d6c7c4459a1d8db782333426e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaef54a6-ed5b-4669-a9d8-d59f47ccb75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaef54a6-ed5b-4669-a9d8-d59f47ccb75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22292991-ae03-4fd3-94b0-07063b830714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22292991-ae03-4fd3-94b0-07063b830714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e285c58-504f-4ad3-a248-60ca79c2ddd2', 'volume_name': 'volume-9e285c58-504f-4ad3-a248-60ca79c2ddd2', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93962243-53df-46a1-881f-65be16972349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93962243-53df-46a1-881f-65be16972349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5bb893e-ebac-4293-989e-702bc100e6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:25 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Volume 9e285c58-504f-4ad3-a248-60ca79c2ddd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e285c58-504f-4ad3-a248-60ca79c2ddd2', 'volume_size': 1} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-824360338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e285c58-504f-4ad3-a248-60ca79c2ddd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0559227864be4bd09621397be023b5f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:42:25Z,use_quota=True,user_id='419be06d6c7c4459a1d8db782333426e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Creating volume 9e285c58-504f-4ad3-a248-60ca79c2ddd2 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:42:25 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e285c58-504f-4ad3-a248-60ca79c2ddd2 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:25 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e285c58-504f-4ad3-a248-60ca79c2ddd2 1073741824 Sep 23 12:42:25 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Flow 'volume_create_manager' (31414839-d17a-47db-8fe8-c1008c5e51cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a2f1db-292e-443b-b366-68f48a563da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a2f1db-292e-443b-b366-68f48a563da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1928425325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037f50b8-c4be-49c1-b59e-7f86b9b85566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a27c60a3fa48e892c4ee187c434d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:42:26Z,use_quota=True,user_id='7fdb6ee9a58c408894fb22973e89c3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d014cce-63c8-4f51-8261-d165d9db0fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d014cce-63c8-4f51-8261-d165d9db0fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537fdfe7-3f84-422c-99a4-2293f78877ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537fdfe7-3f84-422c-99a4-2293f78877ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '037f50b8-c4be-49c1-b59e-7f86b9b85566', 'volume_name': 'volume-037f50b8-c4be-49c1-b59e-7f86b9b85566', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc12171-ffd0-4c5a-a690-3f0586e9c1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc12171-ffd0-4c5a-a690-3f0586e9c1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab36619-3fe8-4801-840e-2b665aa15315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:26 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Volume 037f50b8-c4be-49c1-b59e-7f86b9b85566: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-037f50b8-c4be-49c1-b59e-7f86b9b85566', 'volume_size': 1} Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:42:26 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e285c58-504f-4ad3-a248-60ca79c2ddd2 1073741824" returned: 0 in 0.667s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e285c58-504f-4ad3-a248-60ca79c2ddd2 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:26 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e285c58-504f-4ad3-a248-60ca79c2ddd2 Sep 23 12:42:26 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:26 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e285c58-504f-4ad3-a248-60ca79c2ddd2" returned: 0 in 0.341s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.844s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1928425325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037f50b8-c4be-49c1-b59e-7f86b9b85566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a27c60a3fa48e892c4ee187c434d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:42:26Z,use_quota=True,user_id='7fdb6ee9a58c408894fb22973e89c3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Creating volume 037f50b8-c4be-49c1-b59e-7f86b9b85566 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:42:26 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-037f50b8-c4be-49c1-b59e-7f86b9b85566 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5bb893e-ebac-4293-989e-702bc100e6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e285c58-504f-4ad3-a248-60ca79c2ddd2', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7047969a-a83e-42b4-b7bf-101def73733c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:26 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-037f50b8-c4be-49c1-b59e-7f86b9b85566 1073741824 Sep 23 12:42:26 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:26 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Volume volume-9e285c58-504f-4ad3-a248-60ca79c2ddd2 (9e285c58-504f-4ad3-a248-60ca79c2ddd2): created successfully Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7047969a-a83e-42b4-b7bf-101def73733c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Flow 'volume_create_manager' (fddd72a6-3f6a-4be9-a9fa-8d03b743d675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:42:26 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-20cd688b-d27e-4b0a-a099-6d230981647f tempest-VolumesTransfersV355Test-831516984 None] Created volume successfully. Sep 23 12:42:27 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-037f50b8-c4be-49c1-b59e-7f86b9b85566 1073741824" returned: 0 in 0.569s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-037f50b8-c4be-49c1-b59e-7f86b9b85566 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:27 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-037f50b8-c4be-49c1-b59e-7f86b9b85566 Sep 23 12:42:27 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:27 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-037f50b8-c4be-49c1-b59e-7f86b9b85566" returned: 0 in 0.367s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:42:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:42:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab36619-3fe8-4801-840e-2b665aa15315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-037f50b8-c4be-49c1-b59e-7f86b9b85566', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61afdc62-aa71-4159-95a6-4f601865daac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:27 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Volume volume-037f50b8-c4be-49c1-b59e-7f86b9b85566 (037f50b8-c4be-49c1-b59e-7f86b9b85566): created successfully Sep 23 12:42:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61afdc62-aa71-4159-95a6-4f601865daac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Flow 'volume_create_manager' (31414839-d17a-47db-8fe8-c1008c5e51cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:42:27 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-83dd1c54-21aa-454a-8146-bc5f7a474437 tempest-AttachVolumeNegativeTest-321616029 None] Created volume successfully. Sep 23 12:42:28 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] Acquiring lock "cinder-9e285c58-504f-4ad3-a248-60ca79c2ddd2-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:42:28 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] Lock "cinder-9e285c58-504f-4ad3-a248-60ca79c2ddd2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:42:28 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] Acquiring lock "cinder-quobyte-9e285c58-504f-4ad3-a248-60ca79c2ddd2" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:42:28 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] Lock "cinder-quobyte-9e285c58-504f-4ad3-a248-60ca79c2ddd2" acquired by "delete_volume" :: waited 0.027s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:42:28 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cbcfeb-f020-4d1a-99ab-802d7fbc23f0]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:42:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e285c58-504f-4ad3-a248-60ca79c2ddd2 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:28 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e285c58-504f-4ad3-a248-60ca79c2ddd2 Sep 23 12:42:28 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:28 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e285c58-504f-4ad3-a248-60ca79c2ddd2" returned: 0 in 0.548s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e285c58-504f-4ad3-a248-60ca79c2ddd2 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:28 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e285c58-504f-4ad3-a248-60ca79c2ddd2 Sep 23 12:42:28 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:29 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e285c58-504f-4ad3-a248-60ca79c2ddd2" returned: 0 in 0.343s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:29 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] Lock "cinder-quobyte-9e285c58-504f-4ad3-a248-60ca79c2ddd2" released by "delete_volume" :: held 0.973s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:42:29 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] Created reservations ['097daf71-1acd-402c-b89f-a6f2e4fcdfcc', '9c38445c-6e3d-44e1-943f-a73142045b44', 'b7737f11-1d91-4faf-bc11-a20eccb0d151', '497805a9-321e-4b11-b9cc-8f3fb05fd310'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:42:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:42:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:42:29 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:42:29 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:42:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:42:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:29 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:42:29 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:29 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.517s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:29 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:42:29 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] Deleted volume successfully. Sep 23 12:42:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-32b7f27d-3df8-4d15-b2af-607bc7864d8f tempest-VolumesTransfersV355Test-1665527778 None] Lock "cinder-9e285c58-504f-4ad3-a248-60ca79c2ddd2-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:42:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-95baf052-43db-45e1-9683-a624b43107e9 req-bfcd2492-eeae-43f3-bbb0-8f3a75b7da79 tempest-AttachVolumeNegativeTest-321616029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:42:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-95baf052-43db-45e1-9683-a624b43107e9 req-bfcd2492-eeae-43f3-bbb0-8f3a75b7da79 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:42:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-95baf052-43db-45e1-9683-a624b43107e9 req-bfcd2492-eeae-43f3-bbb0-8f3a75b7da79 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:42:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-95baf052-43db-45e1-9683-a624b43107e9 req-bfcd2492-eeae-43f3-bbb0-8f3a75b7da79 tempest-AttachVolumeNegativeTest-321616029 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-037f50b8-c4be-49c1-b59e-7f86b9b85566', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b6c501a-5dde-49df-8cff-09e326af8464', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:42:30 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-95baf052-43db-45e1-9683-a624b43107e9 req-bfcd2492-eeae-43f3-bbb0-8f3a75b7da79 tempest-AttachVolumeNegativeTest-321616029 None] attachment_update completed successfully. Sep 23 12:42:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-984b75ed-1a0c-417f-bdae-905e03da6443 tempest-VolumesActionsTest-1116303169 None] Acquiring lock "cinder-b5612bfc-1399-4bc6-9dcd-181a83061ab0" by "attach_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:42:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-984b75ed-1a0c-417f-bdae-905e03da6443 tempest-VolumesActionsTest-1116303169 None] Lock "cinder-b5612bfc-1399-4bc6-9dcd-181a83061ab0" acquired by "attach_volume" :: waited 0.024s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:42:36 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-984b75ed-1a0c-417f-bdae-905e03da6443 tempest-VolumesActionsTest-1116303169 None] Attaching volume b5612bfc-1399-4bc6-9dcd-181a83061ab0 to instance a43e6057-9ccf-4bda-9683-e3014fd2ba73 at mountpoint /dev/vdb on host None. Sep 23 12:42:36 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-984b75ed-1a0c-417f-bdae-905e03da6443 tempest-VolumesActionsTest-1116303169 None] Attach volume completed successfully. Sep 23 12:42:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-984b75ed-1a0c-417f-bdae-905e03da6443 tempest-VolumesActionsTest-1116303169 None] Lock "cinder-b5612bfc-1399-4bc6-9dcd-181a83061ab0" released by "attach_volume" :: held 0.162s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:42:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-622dccfe-b124-4dd7-909e-afed08fb8824 tempest-VolumesActionsTest-1116303169 None] Acquiring lock "cinder-b5612bfc-1399-4bc6-9dcd-181a83061ab0-detach_volume" by "detach_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:42:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-622dccfe-b124-4dd7-909e-afed08fb8824 tempest-VolumesActionsTest-1116303169 None] Lock "cinder-b5612bfc-1399-4bc6-9dcd-181a83061ab0-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:42:37 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-622dccfe-b124-4dd7-909e-afed08fb8824 tempest-VolumesActionsTest-1116303169 None] Detaching volume b5612bfc-1399-4bc6-9dcd-181a83061ab0 from instance a43e6057-9ccf-4bda-9683-e3014fd2ba73. Sep 23 12:42:37 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-622dccfe-b124-4dd7-909e-afed08fb8824 tempest-VolumesActionsTest-1116303169 None] Detach volume completed successfully. Sep 23 12:42:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-622dccfe-b124-4dd7-909e-afed08fb8824 tempest-VolumesActionsTest-1116303169 None] Lock "cinder-b5612bfc-1399-4bc6-9dcd-181a83061ab0-detach_volume" released by "detach_volume" :: held 0.126s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:42:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:42:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:42:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:42:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:42:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:42:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:42:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:41 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:42:41 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:41 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.326s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:41 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:42:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:42:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:42:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Flow 'volume_create_manager' (16b3bfa4-cbd0-4b94-9fe4-52eba6096079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec18dc28-8cf5-49ff-bf7b-71278a1ab08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec18dc28-8cf5-49ff-bf7b-71278a1ab08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-836760623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98829d8-a8c1-426a-8330-301b1e7597fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68fdc2dfcdb4126904bb795d365c007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:42:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:42:45Z,use_quota=True,user_id='683c9897048c4c02bd4da015dd52cbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd31dec-9ca9-47cd-9178-bc038f5a533c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd31dec-9ca9-47cd-9178-bc038f5a533c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f599e75f-1f0b-4b05-8b57-4c74c65bb3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f599e75f-1f0b-4b05-8b57-4c74c65bb3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f98829d8-a8c1-426a-8330-301b1e7597fe', 'volume_name': 'volume-f98829d8-a8c1-426a-8330-301b1e7597fe', 'volume_size': 2}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb0f60d-3e8b-410b-ab54-2dabcbec5e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb0f60d-3e8b-410b-ab54-2dabcbec5e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b2231c-b195-4847-a858-710d604fb7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:45 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Volume f98829d8-a8c1-426a-8330-301b1e7597fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f98829d8-a8c1-426a-8330-301b1e7597fe', 'volume_size': 2} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-836760623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98829d8-a8c1-426a-8330-301b1e7597fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68fdc2dfcdb4126904bb795d365c007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:42:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:42:45Z,use_quota=True,user_id='683c9897048c4c02bd4da015dd52cbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Creating volume f98829d8-a8c1-426a-8330-301b1e7597fe {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:42:45 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f98829d8-a8c1-426a-8330-301b1e7597fe 2147483648 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:45 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f98829d8-a8c1-426a-8330-301b1e7597fe 2147483648 Sep 23 12:42:45 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1de2a287-9578-4f05-b20b-6c9ad1094a96 tempest-VolumesActionsTest-1116303169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:42:46 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f98829d8-a8c1-426a-8330-301b1e7597fe 2147483648" returned: 0 in 0.785s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f98829d8-a8c1-426a-8330-301b1e7597fe {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:46 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f98829d8-a8c1-426a-8330-301b1e7597fe Sep 23 12:42:46 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:46 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f98829d8-a8c1-426a-8330-301b1e7597fe" returned: 0 in 0.351s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:46 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:42:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:42:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1de2a287-9578-4f05-b20b-6c9ad1094a96 tempest-VolumesActionsTest-1116303169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.980s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:42:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b2231c-b195-4847-a858-710d604fb7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f98829d8-a8c1-426a-8330-301b1e7597fe', 'volume_size': 2}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2b12fc-ef9d-456b-b9f1-ad60578c4123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:42:46 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[278197ba-ec32-4742-bf62-c9e3ae6aeb7f]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:42:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1de2a287-9578-4f05-b20b-6c9ad1094a96 tempest-VolumesActionsTest-1116303169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:46 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Volume volume-f98829d8-a8c1-426a-8330-301b1e7597fe (f98829d8-a8c1-426a-8330-301b1e7597fe): created successfully Sep 23 12:42:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2b12fc-ef9d-456b-b9f1-ad60578c4123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:42:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Flow 'volume_create_manager' (16b3bfa4-cbd0-4b94-9fe4-52eba6096079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:42:46 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-9970464b-b3f5-40b1-997f-d50d70915c35 tempest-VolumesCloneNegativeTest-40731078 None] Created volume successfully. Sep 23 12:42:47 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 Sep 23 12:42:47 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:47 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1de2a287-9578-4f05-b20b-6c9ad1094a96 tempest-VolumesActionsTest-1116303169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0" returned: 0 in 0.888s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:47 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1000e9e4-2c51-48cf-af60-409975fde9ac]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:42:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1de2a287-9578-4f05-b20b-6c9ad1094a96 tempest-VolumesActionsTest-1116303169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] Acquiring lock "cinder-f98829d8-a8c1-426a-8330-301b1e7597fe-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:42:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] Lock "cinder-f98829d8-a8c1-426a-8330-301b1e7597fe-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:42:48 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 Sep 23 12:42:48 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] Acquiring lock "cinder-quobyte-f98829d8-a8c1-426a-8330-301b1e7597fe" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:42:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] Lock "cinder-quobyte-f98829d8-a8c1-426a-8330-301b1e7597fe" acquired by "delete_volume" :: waited 0.052s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:42:48 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5785d5-1b4d-431e-babd-e0dcfcaeba0d]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:42:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f98829d8-a8c1-426a-8330-301b1e7597fe {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:48 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1de2a287-9578-4f05-b20b-6c9ad1094a96 tempest-VolumesActionsTest-1116303169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0" returned: 0 in 0.770s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1de2a287-9578-4f05-b20b-6c9ad1094a96 tempest-VolumesActionsTest-1116303169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 /opt/stack/data/cinder/conversion/b5612bfc-1399-4bc6-9dcd-181a83061ab0.temp_image.b630e810-b8c4-4f28-be3b-1b15bd259eafip17y1gv.img {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:48 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f98829d8-a8c1-426a-8330-301b1e7597fe Sep 23 12:42:48 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:48 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 /opt/stack/data/cinder/conversion/b5612bfc-1399-4bc6-9dcd-181a83061ab0.temp_image.b630e810-b8c4-4f28-be3b-1b15bd259eafip17y1gv.img Sep 23 12:42:48 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:49 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f98829d8-a8c1-426a-8330-301b1e7597fe" returned: 0 in 1.048s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f98829d8-a8c1-426a-8330-301b1e7597fe {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:49 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f98829d8-a8c1-426a-8330-301b1e7597fe Sep 23 12:42:49 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:50 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f98829d8-a8c1-426a-8330-301b1e7597fe" returned: 0 in 1.351s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] Lock "cinder-quobyte-f98829d8-a8c1-426a-8330-301b1e7597fe" released by "delete_volume" :: held 2.573s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:42:51 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] Created reservations ['7731601e-bf5c-4489-83ea-14bcc911c43f', 'b507863f-dcf8-4eaf-85aa-c877d485253b', '3a5f4eb4-7784-4e9a-b6ce-a98e445287a0', '80a654c7-c521-4004-ac8e-90b7952191f0'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:42:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:42:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:42:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:42:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:42:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:42:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:42:51 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:42:51 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:42:52 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Sep 23 12:42:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.831s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:42:52 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:42:52 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] Deleted volume successfully. Sep 23 12:42:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-068fbba2-93b7-4721-abb2-6b92cc861b58 tempest-VolumesCloneNegativeTest-40731078 None] Lock "cinder-f98829d8-a8c1-426a-8330-301b1e7597fe-delete_volume" released by "delete_volume" :: held 4.211s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:43:01 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=43,cinder:INSERT=11,cinder:UPDATE=49,cinder:DELETE=4 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:43:02 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=45,cinder:UPDATE=39,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:43:02 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1de2a287-9578-4f05-b20b-6c9ad1094a96 tempest-VolumesActionsTest-1116303169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 /opt/stack/data/cinder/conversion/b5612bfc-1399-4bc6-9dcd-181a83061ab0.temp_image.b630e810-b8c4-4f28-be3b-1b15bd259eafip17y1gv.img" returned: 0 in 14.104s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:02 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9bec2e-5c6a-4e10-91b6-a83ed6029c78]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:43:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1de2a287-9578-4f05-b20b-6c9ad1094a96 tempest-VolumesActionsTest-1116303169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:03 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 Sep 23 12:43:03 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:03 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1de2a287-9578-4f05-b20b-6c9ad1094a96 tempest-VolumesActionsTest-1116303169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0" returned: 0 in 0.900s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:03 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-1de2a287-9578-4f05-b20b-6c9ad1094a96 tempest-VolumesActionsTest-1116303169 None] Image conversion details: src /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0, size 1024.00 MB, duration 14.11 sec, destination /opt/stack/data/cinder/conversion/b5612bfc-1399-4bc6-9dcd-181a83061ab0.temp_image.b630e810-b8c4-4f28-be3b-1b15bd259eafip17y1gv.img {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:43:03 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-1de2a287-9578-4f05-b20b-6c9ad1094a96 tempest-VolumesActionsTest-1116303169 None] Converted 1024.00 MB image at 72.60 MB/s Sep 23 12:43:03 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-1de2a287-9578-4f05-b20b-6c9ad1094a96 tempest-VolumesActionsTest-1116303169 None] b630e810-b8c4-4f28-be3b-1b15bd259eaf was raw, no need to convert to raw {{(pid=86085) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Flow 'volume_create_manager' (5fcb70ed-ad8b-47fc-9194-6dd1353d8573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909aaa37-bc6e-403e-b985-9e4dbb084006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909aaa37-bc6e-403e-b985-9e4dbb084006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1229210102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b953b4-b3aa-4f62-a481-1b78b340cd01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad0ed4c3d40e41d9b1db4bc6eb6722bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:43:05Z,use_quota=True,user_id='c5daf53bb0f64249a2b1f2bb7103218e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a680940-eb40-4918-9ced-3323cd990998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a680940-eb40-4918-9ced-3323cd990998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b3823c-f4e5-45e5-bd43-be2e50797d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b3823c-f4e5-45e5-bd43-be2e50797d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13b953b4-b3aa-4f62-a481-1b78b340cd01', 'volume_name': 'volume-13b953b4-b3aa-4f62-a481-1b78b340cd01', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab69957-8ebc-4137-80f6-9ec238ed89a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab69957-8ebc-4137-80f6-9ec238ed89a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea309f2a-e52f-4bc2-a8e0-ea5f2aca27c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:05 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Volume 13b953b4-b3aa-4f62-a481-1b78b340cd01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13b953b4-b3aa-4f62-a481-1b78b340cd01', 'volume_size': 1} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Flow 'volume_create_manager' (7e5c2adb-aa15-4cf9-8384-40b76e575418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee849c8-660c-42b9-8fdb-f156db0d4ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee849c8-660c-42b9-8fdb-f156db0d4ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1633363652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2773e1-732e-42dc-8d17-277288832043,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='80b273046366496ba921661e81f7e0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:43:05Z,use_quota=True,user_id='af6b8fb1b4fa4021ab68c54c012116c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4160a32b-527f-45b9-b2ff-264856c20026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4160a32b-527f-45b9-b2ff-264856c20026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4dc6967-7511-4452-8366-ff87bf6460de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4dc6967-7511-4452-8366-ff87bf6460de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b2773e1-732e-42dc-8d17-277288832043', 'volume_name': 'volume-9b2773e1-732e-42dc-8d17-277288832043', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3d5cbf-b618-4210-aaa9-af19e1429120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3d5cbf-b618-4210-aaa9-af19e1429120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d010fa0-e9ac-4d85-b7d8-27434e462f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:05 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Volume 9b2773e1-732e-42dc-8d17-277288832043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b2773e1-732e-42dc-8d17-277288832043', 'volume_size': 1} Sep 23 12:43:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:43:15 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:43:15 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:43:24 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-5025af64-ddc6-48b1-8005-e381244a4628 req-d3ffcafa-2eed-4782-b6d1-5c5e8e0c6c28 tempest-AttachVolumeNegativeTest-321616029 None] Terminate volume connection completed successfully. Sep 23 12:43:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-5025af64-ddc6-48b1-8005-e381244a4628 req-d3ffcafa-2eed-4782-b6d1-5c5e8e0c6c28 tempest-AttachVolumeNegativeTest-321616029 None] Deleting attachment 0b6c501a-5dde-49df-8cff-09e326af8464. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:43:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1de2a287-9578-4f05-b20b-6c9ad1094a96 tempest-VolumesActionsTest-1116303169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.710s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:43:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1de2a287-9578-4f05-b20b-6c9ad1094a96 tempest-VolumesActionsTest-1116303169 None] Uploaded volume to glance image-id: b630e810-b8c4-4f28-be3b-1b15bd259eaf. {{(pid=86085) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 12:43:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.264s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:43:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1229210102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b953b4-b3aa-4f62-a481-1b78b340cd01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad0ed4c3d40e41d9b1db4bc6eb6722bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:43:05Z,use_quota=True,user_id='c5daf53bb0f64249a2b1f2bb7103218e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:43:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Creating volume 13b953b4-b3aa-4f62-a481-1b78b340cd01 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:43:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:43:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:43:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:43:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:43:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:43:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:43:26 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:43:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-13b953b4-b3aa-4f62-a481-1b78b340cd01 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:26 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-1de2a287-9578-4f05-b20b-6c9ad1094a96 tempest-VolumesActionsTest-1116303169 None] Copy volume to image completed successfully. Sep 23 12:43:26 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-13b953b4-b3aa-4f62-a481-1b78b340cd01 1073741824 Sep 23 12:43:26 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:27 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-13b953b4-b3aa-4f62-a481-1b78b340cd01 1073741824" returned: 0 in 0.623s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-13b953b4-b3aa-4f62-a481-1b78b340cd01 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:27 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-13b953b4-b3aa-4f62-a481-1b78b340cd01 Sep 23 12:43:27 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:27 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-13b953b4-b3aa-4f62-a481-1b78b340cd01" returned: 0 in 0.323s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.027s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1633363652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2773e1-732e-42dc-8d17-277288832043,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='80b273046366496ba921661e81f7e0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:43:05Z,use_quota=True,user_id='af6b8fb1b4fa4021ab68c54c012116c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Creating volume 9b2773e1-732e-42dc-8d17-277288832043 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:43:27 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b2773e1-732e-42dc-8d17-277288832043 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea309f2a-e52f-4bc2-a8e0-ea5f2aca27c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13b953b4-b3aa-4f62-a481-1b78b340cd01', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:27 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b2773e1-732e-42dc-8d17-277288832043 1073741824 Sep 23 12:43:27 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3805ef-40ab-4fc8-8f8a-b3fe4d153a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:27 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Volume volume-13b953b4-b3aa-4f62-a481-1b78b340cd01 (13b953b4-b3aa-4f62-a481-1b78b340cd01): created successfully Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3805ef-40ab-4fc8-8f8a-b3fe4d153a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Flow 'volume_create_manager' (5fcb70ed-ad8b-47fc-9194-6dd1353d8573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:43:27 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-49c601a2-f0ce-4fff-963a-7c0686d49827 tempest-TestMinimumBasicScenario-1511788017 None] Created volume successfully. Sep 23 12:43:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:43:28 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b2773e1-732e-42dc-8d17-277288832043 1073741824" returned: 0 in 0.553s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b2773e1-732e-42dc-8d17-277288832043 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:28 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b2773e1-732e-42dc-8d17-277288832043 Sep 23 12:43:28 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:28 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b2773e1-732e-42dc-8d17-277288832043" returned: 0 in 0.269s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:28 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:43:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:43:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.535s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:43:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d010fa0-e9ac-4d85-b7d8-27434e462f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b2773e1-732e-42dc-8d17-277288832043', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e0ecb7d-8ec3-42b5-8815-53191bd06181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:28 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf0f0c9-d67c-477c-8eaa-1de575c00d87]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:43:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:28 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Volume volume-9b2773e1-732e-42dc-8d17-277288832043 (9b2773e1-732e-42dc-8d17-277288832043): created successfully Sep 23 12:43:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e0ecb7d-8ec3-42b5-8815-53191bd06181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Flow 'volume_create_manager' (7e5c2adb-aa15-4cf9-8384-40b76e575418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:43:28 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-a424a6fc-09d5-4c7a-bfb1-85b8eef1fd93 tempest-VolumesGetTest-293676142 None] Created volume successfully. Sep 23 12:43:28 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 Sep 23 12:43:28 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:28 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0" returned: 0 in 0.433s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:28 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[054e7459-c83f-469d-bb34-e30eb4bc7d43]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:43:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:29 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 Sep 23 12:43:29 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:29 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0" returned: 0 in 0.489s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 /opt/stack/data/cinder/conversion/b5612bfc-1399-4bc6-9dcd-181a83061ab0.temp_image.462d9908-d5eb-4e87-a904-55310a5ee1cfq4y0neva.img {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:29 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 /opt/stack/data/cinder/conversion/b5612bfc-1399-4bc6-9dcd-181a83061ab0.temp_image.462d9908-d5eb-4e87-a904-55310a5ee1cfq4y0neva.img Sep 23 12:43:29 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-c1c83542-c8a7-4236-8fba-f819506a27d7 req-30885d4c-875f-4f3e-9ce0-f43597d1510b tempest-TestMinimumBasicScenario-1511788017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:43:30 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:43:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Flow 'volume_create_manager' (3ef31779-dc10-45c9-b17e-a75407504918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:43:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1cfc57-ef4f-4931-bc7b-c4d233e164cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1cfc57-ef4f-4931-bc7b-c4d233e164cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:43:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1134444952',display_name='tempest-VolumesGetTest-Volume-1672320990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4427e82-e2ce-405b-b753-cd89733c9d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b273046366496ba921661e81f7e0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:43:30Z,use_quota=True,user_id='af6b8fb1b4fa4021ab68c54c012116c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4633b307-0a00-407e-a393-61da821d1ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4633b307-0a00-407e-a393-61da821d1ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0435ae0f-d657-4cf7-b1fe-c36d04eeb4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0435ae0f-d657-4cf7-b1fe-c36d04eeb4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4427e82-e2ce-405b-b753-cd89733c9d72', 'volume_name': 'volume-d4427e82-e2ce-405b-b753-cd89733c9d72', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3268ae83-c674-4667-9752-cf16c40bbe83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3268ae83-c674-4667-9752-cf16c40bbe83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4340ab8-4659-471d-8291-840ff2403b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:30 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Volume d4427e82-e2ce-405b-b753-cd89733c9d72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4427e82-e2ce-405b-b753-cd89733c9d72', 'volume_size': 1} Sep 23 12:43:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:43:37 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 /opt/stack/data/cinder/conversion/b5612bfc-1399-4bc6-9dcd-181a83061ab0.temp_image.462d9908-d5eb-4e87-a904-55310a5ee1cfq4y0neva.img" returned: 0 in 7.930s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:37 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f7cde0-f0ef-4696-b0b8-4456b6646a66]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:43:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:37 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 Sep 23 12:43:37 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:37 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0" returned: 0 in 0.608s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:37 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] Image conversion details: src /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0, size 1024.00 MB, duration 7.93 sec, destination /opt/stack/data/cinder/conversion/b5612bfc-1399-4bc6-9dcd-181a83061ab0.temp_image.462d9908-d5eb-4e87-a904-55310a5ee1cfq4y0neva.img {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:43:37 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] Converted 1024.00 MB image at 129.12 MB/s Sep 23 12:43:37 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] 462d9908-d5eb-4e87-a904-55310a5ee1cf was raw, converting to qcow2 {{(pid=86085) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 23 12:43:37 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37142b5-aba4-4211-8434-915d06c533c0]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:43:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b5612bfc-1399-4bc6-9dcd-181a83061ab0.temp_image.462d9908-d5eb-4e87-a904-55310a5ee1cfq4y0neva.img {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:38 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b5612bfc-1399-4bc6-9dcd-181a83061ab0.temp_image.462d9908-d5eb-4e87-a904-55310a5ee1cfq4y0neva.img Sep 23 12:43:38 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:38 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b5612bfc-1399-4bc6-9dcd-181a83061ab0.temp_image.462d9908-d5eb-4e87-a904-55310a5ee1cfq4y0neva.img" returned: 0 in 0.362s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b5612bfc-1399-4bc6-9dcd-181a83061ab0.temp_image.462d9908-d5eb-4e87-a904-55310a5ee1cfq4y0neva.img {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:38 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b5612bfc-1399-4bc6-9dcd-181a83061ab0.temp_image.462d9908-d5eb-4e87-a904-55310a5ee1cfq4y0neva.img Sep 23 12:43:38 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:38 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b5612bfc-1399-4bc6-9dcd-181a83061ab0.temp_image.462d9908-d5eb-4e87-a904-55310a5ee1cfq4y0neva.img" returned: 1 in 0.421s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b5612bfc-1399-4bc6-9dcd-181a83061ab0.temp_image.462d9908-d5eb-4e87-a904-55310a5ee1cfq4y0neva.img' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:43:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b5612bfc-1399-4bc6-9dcd-181a83061ab0.temp_image.462d9908-d5eb-4e87-a904-55310a5ee1cfq4y0neva.img /opt/stack/data/cinder/conversion/vol_upload_h86b8_ux {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:38 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b5612bfc-1399-4bc6-9dcd-181a83061ab0.temp_image.462d9908-d5eb-4e87-a904-55310a5ee1cfq4y0neva.img /opt/stack/data/cinder/conversion/vol_upload_h86b8_ux Sep 23 12:43:38 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:39 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b5612bfc-1399-4bc6-9dcd-181a83061ab0.temp_image.462d9908-d5eb-4e87-a904-55310a5ee1cfq4y0neva.img /opt/stack/data/cinder/conversion/vol_upload_h86b8_ux" returned: 0 in 0.288s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:39 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] Image conversion details: src /opt/stack/data/cinder/conversion/b5612bfc-1399-4bc6-9dcd-181a83061ab0.temp_image.462d9908-d5eb-4e87-a904-55310a5ee1cfq4y0neva.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_h86b8_ux {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:43:39 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 23 12:43:39 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d40a12-d4f3-4444-8f14-165bd9efcc03]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:43:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h86b8_ux {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:39 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h86b8_ux Sep 23 12:43:39 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:39 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h86b8_ux" returned: 0 in 0.362s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.858s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] Uploaded volume to glance image-id: 462d9908-d5eb-4e87-a904-55310a5ee1cf. {{(pid=86085) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-c1c83542-c8a7-4236-8fba-f819506a27d7 req-30885d4c-875f-4f3e-9ce0-f43597d1510b tempest-TestMinimumBasicScenario-1511788017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.096s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-c1c83542-c8a7-4236-8fba-f819506a27d7 req-30885d4c-875f-4f3e-9ce0-f43597d1510b tempest-TestMinimumBasicScenario-1511788017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.615s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:43:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1134444952',display_name='tempest-VolumesGetTest-Volume-1672320990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4427e82-e2ce-405b-b753-cd89733c9d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b273046366496ba921661e81f7e0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:43:30Z,use_quota=True,user_id='af6b8fb1b4fa4021ab68c54c012116c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Creating volume d4427e82-e2ce-405b-b753-cd89733c9d72 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:43:41 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4427e82-e2ce-405b-b753-cd89733c9d72 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:41 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-357a8200-3ecd-41d2-83dc-2e9d6f165807 tempest-VolumesActionsTest-1116303169 None] Copy volume to image completed successfully. Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:43:41 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4427e82-e2ce-405b-b753-cd89733c9d72 1073741824 Sep 23 12:43:41 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-c1c83542-c8a7-4236-8fba-f819506a27d7 req-30885d4c-875f-4f3e-9ce0-f43597d1510b tempest-TestMinimumBasicScenario-1511788017 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-13b953b4-b3aa-4f62-a481-1b78b340cd01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef763dc1-75b4-4715-83a8-a227c30f975f', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:43:41 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:43:41 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:41 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-c1c83542-c8a7-4236-8fba-f819506a27d7 req-30885d4c-875f-4f3e-9ce0-f43597d1510b tempest-TestMinimumBasicScenario-1511788017 None] attachment_update completed successfully. Sep 23 12:43:42 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.657s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:42 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:43:42 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:43:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:43:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:43:42 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4427e82-e2ce-405b-b753-cd89733c9d72 1073741824" returned: 0 in 0.924s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4427e82-e2ce-405b-b753-cd89733c9d72 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:42 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4427e82-e2ce-405b-b753-cd89733c9d72 Sep 23 12:43:42 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:42 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4427e82-e2ce-405b-b753-cd89733c9d72" returned: 0 in 0.404s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:43:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:43:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4340ab8-4659-471d-8291-840ff2403b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4427e82-e2ce-405b-b753-cd89733c9d72', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829473da-d402-4dd6-b64e-ef09f49a1aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:42 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Volume volume-d4427e82-e2ce-405b-b753-cd89733c9d72 (d4427e82-e2ce-405b-b753-cd89733c9d72): created successfully Sep 23 12:43:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829473da-d402-4dd6-b64e-ef09f49a1aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Flow 'volume_create_manager' (3ef31779-dc10-45c9-b17e-a75407504918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:43:42 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-bdaa332d-398f-4f6a-9139-bba59264cfa4 tempest-VolumesGetTest-293676142 None] Created volume successfully. Sep 23 12:43:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] Acquiring lock "cinder-b5612bfc-1399-4bc6-9dcd-181a83061ab0-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:43:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] Lock "cinder-b5612bfc-1399-4bc6-9dcd-181a83061ab0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:43:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] Acquiring lock "cinder-quobyte-b5612bfc-1399-4bc6-9dcd-181a83061ab0" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:43:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] Lock "cinder-quobyte-b5612bfc-1399-4bc6-9dcd-181a83061ab0" acquired by "delete_volume" :: waited 0.025s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:43:43 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c463db-3e0c-40f2-aff5-d05834c2973b]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:43:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:43 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 Sep 23 12:43:43 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] Acquiring lock "cinder-d4427e82-e2ce-405b-b753-cd89733c9d72-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:43:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] Lock "cinder-d4427e82-e2ce-405b-b753-cd89733c9d72-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:43:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] Acquiring lock "cinder-quobyte-d4427e82-e2ce-405b-b753-cd89733c9d72" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:43:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] Lock "cinder-quobyte-d4427e82-e2ce-405b-b753-cd89733c9d72" acquired by "delete_volume" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:43:44 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0" returned: 0 in 0.891s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:44 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0 Sep 23 12:43:44 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:44 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fa89ac-e4cb-4a3f-bca3-0ed9007e6f1e]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:43:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4427e82-e2ce-405b-b753-cd89733c9d72 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:44 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4427e82-e2ce-405b-b753-cd89733c9d72 Sep 23 12:43:44 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:44 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5612bfc-1399-4bc6-9dcd-181a83061ab0" returned: 0 in 0.434s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] Lock "cinder-quobyte-b5612bfc-1399-4bc6-9dcd-181a83061ab0" released by "delete_volume" :: held 1.444s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:43:44 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] Created reservations ['e84dd36c-836b-4ec7-a79d-3d892fb946fc', '363ef583-1137-4436-a59a-ea1a79f6cb6f', '02f27398-ecb5-44f3-905b-ad83a7772c4d', '56c4fa07-c0f9-47c7-a2ef-6a81d4afca6f'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:43:44 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4427e82-e2ce-405b-b753-cd89733c9d72" returned: 0 in 0.616s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4427e82-e2ce-405b-b753-cd89733c9d72 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:44 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4427e82-e2ce-405b-b753-cd89733c9d72 Sep 23 12:43:44 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:43:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:43:44 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:43:44 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:43:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:43:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:44 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:43:44 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:45 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d4427e82-e2ce-405b-b753-cd89733c9d72" returned: 0 in 0.477s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:45 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.379s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:45 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:43:45 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] Deleted volume successfully. Sep 23 12:43:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] Lock "cinder-quobyte-d4427e82-e2ce-405b-b753-cd89733c9d72" released by "delete_volume" :: held 1.196s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:43:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-99ab2a30-34a0-4007-a1b7-576e6f632b9e tempest-VolumesActionsTest-1116303169 None] Lock "cinder-b5612bfc-1399-4bc6-9dcd-181a83061ab0-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:43:45 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] Created reservations ['ccc82af7-64a9-4dde-bf56-465fd122589b', '8eec957a-556f-4bf6-92b8-f4256c886f44', '2fc90460-4dd2-493f-9193-1a2feb6e8cfc', 'e319f706-9775-438a-85c7-59bf1f9ee9da'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:43:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:43:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:43:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:43:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:43:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:43:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:45 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:43:45 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:45 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.376s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:45 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:43:45 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] Deleted volume successfully. Sep 23 12:43:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-eec4efe4-bb96-4e05-b4cd-6b9409f16def tempest-VolumesGetTest-293676142 None] Lock "cinder-d4427e82-e2ce-405b-b753-cd89733c9d72-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:43:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] Acquiring lock "cinder-9b2773e1-732e-42dc-8d17-277288832043-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:43:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] Lock "cinder-9b2773e1-732e-42dc-8d17-277288832043-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:43:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] Acquiring lock "cinder-quobyte-9b2773e1-732e-42dc-8d17-277288832043" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:43:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] Lock "cinder-quobyte-9b2773e1-732e-42dc-8d17-277288832043" acquired by "delete_volume" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:43:46 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[4393d930-8562-422c-89ae-849949bc84a2]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:43:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b2773e1-732e-42dc-8d17-277288832043 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:46 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b2773e1-732e-42dc-8d17-277288832043 Sep 23 12:43:46 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:47 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b2773e1-732e-42dc-8d17-277288832043" returned: 0 in 0.481s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b2773e1-732e-42dc-8d17-277288832043 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:47 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b2773e1-732e-42dc-8d17-277288832043 Sep 23 12:43:47 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:47 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b2773e1-732e-42dc-8d17-277288832043" returned: 0 in 0.288s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] Lock "cinder-quobyte-9b2773e1-732e-42dc-8d17-277288832043" released by "delete_volume" :: held 0.830s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:43:47 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] Created reservations ['fa4752ce-f78d-4bd9-8678-2a6c4fe03576', 'f22aea04-1423-4464-a0d5-23dfabefe8d1', 'e52034a0-d9b2-4302-842a-2d32dcd510a7', '1f3acfb0-3e93-484d-904d-110c6e4d7a65'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:43:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:43:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:43:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:43:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:43:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:43:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:47 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:43:47 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:48 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.610s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:43:48 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] Deleted volume successfully. Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1a9e9036-f50e-4975-bd3c-f9c2c734c127 tempest-VolumesGetTest-293676142 None] Lock "cinder-9b2773e1-732e-42dc-8d17-277288832043-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Flow 'volume_create_manager' (b5e5c323-6d53-4ac1-819d-bf28708f406e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e83cb26-ca88-48d2-86b1-ecb80f3a7933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e83cb26-ca88-48d2-86b1-ecb80f3a7933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-855084051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c166248b-ab58-4cff-9c10-b69c258393f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b273046366496ba921661e81f7e0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:43:48Z,use_quota=True,user_id='af6b8fb1b4fa4021ab68c54c012116c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e63fcc7-9e53-486e-94ee-b60e688e63f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e63fcc7-9e53-486e-94ee-b60e688e63f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188ad355-4851-4ecd-9833-3baaf9598319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188ad355-4851-4ecd-9833-3baaf9598319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c166248b-ab58-4cff-9c10-b69c258393f0', 'volume_name': 'volume-c166248b-ab58-4cff-9c10-b69c258393f0', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63784f56-da03-4794-ad4c-dd0020cb2169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63784f56-da03-4794-ad4c-dd0020cb2169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347d6a51-ba75-4a1e-b773-409605405d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:48 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Volume c166248b-ab58-4cff-9c10-b69c258393f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c166248b-ab58-4cff-9c10-b69c258393f0', 'volume_size': 1} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-855084051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c166248b-ab58-4cff-9c10-b69c258393f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b273046366496ba921661e81f7e0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:43:48Z,use_quota=True,user_id='af6b8fb1b4fa4021ab68c54c012116c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Creating volume c166248b-ab58-4cff-9c10-b69c258393f0 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:43:48 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:43:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:48 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0 1073741824 Sep 23 12:43:48 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:49 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0 1073741824" returned: 0 in 0.624s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:49 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0 Sep 23 12:43:49 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:49 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0" returned: 0 in 0.346s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:43:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:43:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347d6a51-ba75-4a1e-b773-409605405d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c166248b-ab58-4cff-9c10-b69c258393f0', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b1951b-f592-4ac4-8313-f75e928d5526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:49 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Volume volume-c166248b-ab58-4cff-9c10-b69c258393f0 (c166248b-ab58-4cff-9c10-b69c258393f0): created successfully Sep 23 12:43:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b1951b-f592-4ac4-8313-f75e928d5526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Flow 'volume_create_manager' (b5e5c323-6d53-4ac1-819d-bf28708f406e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:43:49 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-020b2bfe-3cfa-4d68-95a6-615a3e4f1a98 tempest-VolumesGetTest-293676142 None] Created volume successfully. Sep 23 12:43:51 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:43:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Flow 'volume_create_manager' (df7374bb-1471-4cee-93d7-e5d142e4fb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:43:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (431ff345-585e-4aae-b697-f90e37920d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (431ff345-585e-4aae-b697-f90e37920d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-47086850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ceef25-bc4e-4f0b-91f5-43e075c1d8dc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='80b273046366496ba921661e81f7e0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c166248b-ab58-4cff-9c10-b69c258393f0,status='creating',terminated_at=None,updated_at=2026-09-23T10:43:51Z,use_quota=True,user_id='af6b8fb1b4fa4021ab68c54c012116c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf098691-684a-4cae-8ad1-b6035e03e245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf098691-684a-4cae-8ad1-b6035e03e245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ac85d56-1a2a-4207-a74a-10ceca9b2f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ac85d56-1a2a-4207-a74a-10ceca9b2f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '22ceef25-bc4e-4f0b-91f5-43e075c1d8dc', 'volume_name': 'volume-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc', 'volume_size': 1, 'source_volid': 'c166248b-ab58-4cff-9c10-b69c258393f0', 'source_volstatus': 'available'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f4ea9a-b1b7-4330-8e66-f7aa246f26cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f4ea9a-b1b7-4330-8e66-f7aa246f26cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e90357-6d7b-4b53-a843-2b275dccc4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:51 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Volume 22ceef25-bc4e-4f0b-91f5-43e075c1d8dc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc', 'volume_size': 1, 'source_volid': 'c166248b-ab58-4cff-9c10-b69c258393f0', 'source_volstatus': 'available'} Sep 23 12:43:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:43:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:43:51 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Cloning volume c166248b-ab58-4cff-9c10-b69c258393f0 to volume 22ceef25-bc4e-4f0b-91f5-43e075c1d8dc Sep 23 12:43:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Creating offline snapshot 804c1868-218f-4592-9981-7b409d47293d of volume c166248b-ab58-4cff-9c10-b69c258393f0 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:43:51 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcbd22f-e1b6-44b3-b90d-857da4e5fac1]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:43:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:51 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0 Sep 23 12:43:51 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:52 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0" returned: 0 in 0.598s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:52 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d 1G Sep 23 12:43:52 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:52 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d 1G" returned: 0 in 0.578s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c166248b-ab58-4cff-9c10-b69c258393f0 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:52 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c166248b-ab58-4cff-9c10-b69c258393f0 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d Sep 23 12:43:52 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:53 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c166248b-ab58-4cff-9c10-b69c258393f0 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d" returned: 0 in 0.371s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:53 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d is being set with open permissions: ugo+rw Sep 23 12:43:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:53 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d Sep 23 12:43:53 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:53 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d" returned: 0 in 0.326s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:53 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.info Sep 23 12:43:53 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:53 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.info" returned: 0 in 0.358s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:53 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.info is being set with open permissions: ugo+rw Sep 23 12:43:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:53 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.info Sep 23 12:43:53 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:54 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.info" returned: 0 in 0.537s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Acquiring lock "cinder-quobyte-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc" by "_copy_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:43:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Lock "cinder-quobyte-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:43:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] snapshot: 804c1868-218f-4592-9981-7b409d47293d, volume: 22ceef25-bc4e-4f0b-91f5-43e075c1d8dc, {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 12:43:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:43:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:43:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:43:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:43:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:43:54 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fbccc4-be30-47c9-a334-5bde887183ce]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:43:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:54 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d Sep 23 12:43:54 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:55 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d" returned: 0 in 0.739s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c166248b-ab58-4cff-9c10-b69c258393f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e4bed6-e8d3-41ec-b825-f094dc0a7aaf]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:55 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0 Sep 23 12:43:55 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Flow 'volume_create_manager' (0dab79ae-be6b-4c60-9244-e70686a1c654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452cb645-5223-409d-a6f6-013c166e8277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452cb645-5223-409d-a6f6-013c166e8277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1567051119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c13646-0593-4a99-965d-d5ae780480b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa969b59e2704938ac52826678f799e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:43:56Z,use_quota=True,user_id='e87be9a479d747cfb76e01960d0fdca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4083f7cd-1203-465a-8893-0a1d25dd91b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4083f7cd-1203-465a-8893-0a1d25dd91b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf60a918-646c-4589-855f-2d0c4185abfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf60a918-646c-4589-855f-2d0c4185abfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57c13646-0593-4a99-965d-d5ae780480b2', 'volume_name': 'volume-57c13646-0593-4a99-965d-d5ae780480b2', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ed757a-2f37-4c37-a113-a287d3a5a7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ed757a-2f37-4c37-a113-a287d3a5a7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2485ea-e6f3-4fde-b7b0-6301685ca35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:43:55 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Volume 57c13646-0593-4a99-965d-d5ae780480b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57c13646-0593-4a99-965d-d5ae780480b2', 'volume_size': 1} Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:43:55 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0" returned: 0 in 0.541s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] will copy from snapshot at /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0 {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Creating direct copy from snapshot {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG cinder.utils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Path /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc not found in is_blk_device check {{(pid=86085) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 12:43:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:43:55 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc Sep 23 12:43:55 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:03 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc" returned: 0 in 7.636s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:03 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Image conversion details: src /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0, size 1024.00 MB, duration 7.64 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:44:03 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Converted 1024.00 MB image at 134.06 MB/s Sep 23 12:44:03 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc is being set with open permissions: ugo+rw Sep 23 12:44:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:03 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc Sep 23 12:44:03 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:03 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc" returned: 0 in 0.257s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Lock "cinder-quobyte-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc" released by "_copy_volume_from_snapshot" :: held 9.313s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Acquiring lock "cinder-quobyte-804c1868-218f-4592-9981-7b409d47293d" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Lock "cinder-quobyte-804c1868-218f-4592-9981-7b409d47293d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Deleting offline snapshot 804c1868-218f-4592-9981-7b409d47293d of volume c166248b-ab58-4cff-9c10-b69c258393f0 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:44:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] snapshot_file for this snap is: volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:44:03 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[63963949-9ec8-40f2-b4dc-17a7ab5ed728]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:44:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:04 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d Sep 23 12:44:04 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:04 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d" returned: 0 in 0.401s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c166248b-ab58-4cff-9c10-b69c258393f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:44:04 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ba6845-d0da-41fe-af61-09a44d5ed574]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:44:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:04 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0 Sep 23 12:44:04 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:05 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0" returned: 0 in 0.640s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:05 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d Sep 23 12:44:05 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:05 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d" returned: 0 in 0.390s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:05 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d Sep 23 12:44:05 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:05 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0.804c1868-218f-4592-9981-7b409d47293d" returned: 0 in 0.253s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Lock "cinder-quobyte-804c1868-218f-4592-9981-7b409d47293d" released by "_delete_snapshot" :: held 1.844s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.250s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.945s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1567051119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c13646-0593-4a99-965d-d5ae780480b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa969b59e2704938ac52826678f799e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:43:56Z,use_quota=True,user_id='e87be9a479d747cfb76e01960d0fdca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Creating volume 57c13646-0593-4a99-965d-d5ae780480b2 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:44:05 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c13646-0593-4a99-965d-d5ae780480b2 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:05 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c13646-0593-4a99-965d-d5ae780480b2 1073741824 Sep 23 12:44:05 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e90357-6d7b-4b53-a843-2b275dccc4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc', 'volume_size': 1, 'source_volid': 'c166248b-ab58-4cff-9c10-b69c258393f0', 'source_volstatus': 'available'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9743bb67-4342-4838-8ff2-6b3bc9e7320e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:05 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Volume volume-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc (22ceef25-bc4e-4f0b-91f5-43e075c1d8dc): created successfully Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9743bb67-4342-4838-8ff2-6b3bc9e7320e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Flow 'volume_create_manager' (df7374bb-1471-4cee-93d7-e5d142e4fb21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:44:05 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d2ebe0c7-cf8b-4ee6-8cfa-c7d25a1a88b1 tempest-VolumesGetTest-293676142 None] Created volume successfully. Sep 23 12:44:06 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c13646-0593-4a99-965d-d5ae780480b2 1073741824" returned: 0 in 0.661s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c13646-0593-4a99-965d-d5ae780480b2 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:44:06 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c13646-0593-4a99-965d-d5ae780480b2 Sep 23 12:44:06 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Flow 'volume_create_manager' (049b951d-de6d-4e36-befd-5ecdf361ba2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3fdb89-f209-40f6-abef-2315de99f2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3fdb89-f209-40f6-abef-2315de99f2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-493596537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae47e218-a435-43c0-bb19-1f3a98a05ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a27c60a3fa48e892c4ee187c434d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:44:06Z,use_quota=True,user_id='7fdb6ee9a58c408894fb22973e89c3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa89cae-e430-4017-8441-44b5fd99b859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa89cae-e430-4017-8441-44b5fd99b859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ab60b2-b97a-42c3-ab2b-6eb2085580ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ab60b2-b97a-42c3-ab2b-6eb2085580ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae47e218-a435-43c0-bb19-1f3a98a05ae7', 'volume_name': 'volume-ae47e218-a435-43c0-bb19-1f3a98a05ae7', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff842f0-9155-44a7-9f03-708ea7f7b6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff842f0-9155-44a7-9f03-708ea7f7b6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6985f22d-0688-409d-a193-7a1ffc1367bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:06 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Volume ae47e218-a435-43c0-bb19-1f3a98a05ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae47e218-a435-43c0-bb19-1f3a98a05ae7', 'volume_size': 1} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:06 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c13646-0593-4a99-965d-d5ae780480b2" returned: 0 in 0.279s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.182s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-493596537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae47e218-a435-43c0-bb19-1f3a98a05ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a27c60a3fa48e892c4ee187c434d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:44:06Z,use_quota=True,user_id='7fdb6ee9a58c408894fb22973e89c3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Creating volume ae47e218-a435-43c0-bb19-1f3a98a05ae7 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:44:06 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ae47e218-a435-43c0-bb19-1f3a98a05ae7 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:06 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ae47e218-a435-43c0-bb19-1f3a98a05ae7 1073741824 Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2485ea-e6f3-4fde-b7b0-6301685ca35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c13646-0593-4a99-965d-d5ae780480b2', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:06 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e618c5-af1a-4f79-9a64-c52317d6a1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:06 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Volume volume-57c13646-0593-4a99-965d-d5ae780480b2 (57c13646-0593-4a99-965d-d5ae780480b2): created successfully Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e618c5-af1a-4f79-9a64-c52317d6a1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Flow 'volume_create_manager' (0dab79ae-be6b-4c60-9244-e70686a1c654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:44:06 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ac0a560a-6f78-46d8-a37e-01aa0a980ecd tempest-VolumesNegativeTest-367888209 None] Created volume successfully. Sep 23 12:44:07 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ae47e218-a435-43c0-bb19-1f3a98a05ae7 1073741824" returned: 0 in 0.508s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ae47e218-a435-43c0-bb19-1f3a98a05ae7 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:07 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ae47e218-a435-43c0-bb19-1f3a98a05ae7 Sep 23 12:44:07 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:07 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ae47e218-a435-43c0-bb19-1f3a98a05ae7" returned: 0 in 0.370s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6985f22d-0688-409d-a193-7a1ffc1367bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae47e218-a435-43c0-bb19-1f3a98a05ae7', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3112b427-6110-4df2-8f5b-a19630d64ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:07 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Volume volume-ae47e218-a435-43c0-bb19-1f3a98a05ae7 (ae47e218-a435-43c0-bb19-1f3a98a05ae7): created successfully Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3112b427-6110-4df2-8f5b-a19630d64ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Flow 'volume_create_manager' (049b951d-de6d-4e36-befd-5ecdf361ba2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Flow 'volume_create_manager' (11580505-6b57-4eac-b616-df951016bb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5345f9-c5d6-4d48-b716-5dc57c241338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:07 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-4bfbd685-451f-417e-af5b-4563d5633373 tempest-AttachVolumeNegativeTest-321616029 None] Created volume successfully. Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5345f9-c5d6-4d48-b716-5dc57c241338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:44:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1967416101',display_name='tempest-VolumesGetTest-Volume-1025645902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf6d593-584a-4f58-a851-7534ad56878a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b273046366496ba921661e81f7e0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:44:08Z,use_quota=True,user_id='af6b8fb1b4fa4021ab68c54c012116c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a692b0-1445-4315-aa47-974bb3a8a8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a692b0-1445-4315-aa47-974bb3a8a8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356811ee-9088-4bf7-96a7-ea3dd9e9cf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356811ee-9088-4bf7-96a7-ea3dd9e9cf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf6d593-584a-4f58-a851-7534ad56878a', 'volume_name': 'volume-fdf6d593-584a-4f58-a851-7534ad56878a', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606f5f5c-5b01-44ae-975e-c85073980b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606f5f5c-5b01-44ae-975e-c85073980b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225d19f4-2226-475a-8e42-0d995160ea18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:07 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Volume fdf6d593-584a-4f58-a851-7534ad56878a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf6d593-584a-4f58-a851-7534ad56878a', 'volume_size': 1} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:44:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1967416101',display_name='tempest-VolumesGetTest-Volume-1025645902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf6d593-584a-4f58-a851-7534ad56878a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b273046366496ba921661e81f7e0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:44:08Z,use_quota=True,user_id='af6b8fb1b4fa4021ab68c54c012116c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Creating volume fdf6d593-584a-4f58-a851-7534ad56878a {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:44:07 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:44:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdf6d593-584a-4f58-a851-7534ad56878a 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:07 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdf6d593-584a-4f58-a851-7534ad56878a 1073741824 Sep 23 12:44:07 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:08 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdf6d593-584a-4f58-a851-7534ad56878a 1073741824" returned: 0 in 0.492s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdf6d593-584a-4f58-a851-7534ad56878a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:08 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdf6d593-584a-4f58-a851-7534ad56878a Sep 23 12:44:08 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:08 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdf6d593-584a-4f58-a851-7534ad56878a" returned: 0 in 0.442s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:08 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:44:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225d19f4-2226-475a-8e42-0d995160ea18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf6d593-584a-4f58-a851-7534ad56878a', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a59e38-3990-465d-8801-cc2864a144e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:08 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Volume volume-fdf6d593-584a-4f58-a851-7534ad56878a (fdf6d593-584a-4f58-a851-7534ad56878a): created successfully Sep 23 12:44:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a59e38-3990-465d-8801-cc2864a144e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Flow 'volume_create_manager' (11580505-6b57-4eac-b616-df951016bb57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:44:08 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-662a4547-e243-4b8c-8ad5-39ce1e0f35b4 tempest-VolumesGetTest-293676142 None] Created volume successfully. Sep 23 12:44:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-663667a7-fdf6-49ab-bc5e-027b5025366d req-95a9e9d4-b3b4-478a-837f-22ff720b0d17 tempest-AttachVolumeNegativeTest-321616029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-663667a7-fdf6-49ab-bc5e-027b5025366d req-95a9e9d4-b3b4-478a-837f-22ff720b0d17 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-663667a7-fdf6-49ab-bc5e-027b5025366d req-95a9e9d4-b3b4-478a-837f-22ff720b0d17 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:09 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-663667a7-fdf6-49ab-bc5e-027b5025366d req-95a9e9d4-b3b4-478a-837f-22ff720b0d17 tempest-AttachVolumeNegativeTest-321616029 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-ae47e218-a435-43c0-bb19-1f3a98a05ae7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd538f43a-577f-49f7-8979-0e5c36ba2855', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:44:09 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-663667a7-fdf6-49ab-bc5e-027b5025366d req-95a9e9d4-b3b4-478a-837f-22ff720b0d17 tempest-AttachVolumeNegativeTest-321616029 None] attachment_update completed successfully. Sep 23 12:44:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] Acquiring lock "cinder-fdf6d593-584a-4f58-a851-7534ad56878a-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] Lock "cinder-fdf6d593-584a-4f58-a851-7534ad56878a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] Acquiring lock "cinder-quobyte-fdf6d593-584a-4f58-a851-7534ad56878a" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] Lock "cinder-quobyte-fdf6d593-584a-4f58-a851-7534ad56878a" acquired by "delete_volume" :: waited 0.040s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:10 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1e2f07-f71a-472c-8d33-46349e816089]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:44:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdf6d593-584a-4f58-a851-7534ad56878a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:10 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdf6d593-584a-4f58-a851-7534ad56878a Sep 23 12:44:10 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:10 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdf6d593-584a-4f58-a851-7534ad56878a" returned: 0 in 0.471s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdf6d593-584a-4f58-a851-7534ad56878a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:11 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdf6d593-584a-4f58-a851-7534ad56878a Sep 23 12:44:11 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:11 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fdf6d593-584a-4f58-a851-7534ad56878a" returned: 0 in 0.449s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] Lock "cinder-quobyte-fdf6d593-584a-4f58-a851-7534ad56878a" released by "delete_volume" :: held 1.002s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:11 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] Created reservations ['32674ee0-b212-4d06-8bc5-33754c34aa7a', '3a45b938-0691-4308-81f0-c48efbcf395e', 'e45ef0a8-8c9d-4575-bd54-ebfab0616e47', '626b0309-f884-4e98-8afb-aa41ca0778e8'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:44:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:44:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:44:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:11 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:44:11 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:11 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.307s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:11 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:44:11 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] Deleted volume successfully. Sep 23 12:44:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f91e285d-3a92-473b-a585-24ae05cd7488 tempest-VolumesGetTest-293676142 None] Lock "cinder-fdf6d593-584a-4f58-a851-7534ad56878a-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] Acquiring lock "cinder-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] Lock "cinder-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] Acquiring lock "cinder-quobyte-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:12 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] Lock "cinder-quobyte-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc" acquired by "delete_volume" :: waited 0.036s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:12 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a9d64a-5388-445f-9ce1-0e7a5f50b4b6]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:44:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:12 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-5b88c86f-b687-4ed9-9cb6-33c4344ec7ae req-4ecd8691-e0f3-42a5-8c04-a92f39fb291f tempest-AttachVolumeNegativeTest-321616029 None] Terminate volume connection completed successfully. Sep 23 12:44:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-5b88c86f-b687-4ed9-9cb6-33c4344ec7ae req-4ecd8691-e0f3-42a5-8c04-a92f39fb291f tempest-AttachVolumeNegativeTest-321616029 None] Deleting attachment d538f43a-577f-49f7-8979-0e5c36ba2855. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:44:13 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc Sep 23 12:44:13 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:13 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc" returned: 0 in 0.528s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:13 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc Sep 23 12:44:13 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:13 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc" returned: 0 in 0.395s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:13 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] Lock "cinder-quobyte-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc" released by "delete_volume" :: held 1.004s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:14 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] Created reservations ['8840c63a-8e13-4ca7-b8fc-4b5f09b77ad6', 'bad80485-9c07-4bc2-b39d-696ba6a424a3', 'a3796632-7d66-4015-afb2-eee7ee5bba9c', 'f1e360f1-4e0b-4969-83b4-d11c31846fa1'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:44:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:44:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:44:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:14 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:44:14 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:14 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.505s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:14 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:44:14 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] Deleted volume successfully. Sep 23 12:44:14 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6dd59a1d-99e2-4858-8273-97badf78b967 tempest-VolumesGetTest-293676142 None] Lock "cinder-22ceef25-bc4e-4f0b-91f5-43e075c1d8dc-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:15 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] Acquiring lock "cinder-c166248b-ab58-4cff-9c10-b69c258393f0-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:15 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] Lock "cinder-c166248b-ab58-4cff-9c10-b69c258393f0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:15 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] Acquiring lock "cinder-quobyte-c166248b-ab58-4cff-9c10-b69c258393f0" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:15 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] Lock "cinder-quobyte-c166248b-ab58-4cff-9c10-b69c258393f0" acquired by "delete_volume" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:15 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a164867-efb3-4273-8a9c-92bfad6f0f8a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:44:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:15 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0 Sep 23 12:44:15 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:16 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0" returned: 0 in 0.680s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:16 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0 Sep 23 12:44:16 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c166248b-ab58-4cff-9c10-b69c258393f0" returned: 0 in 0.473s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:16 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:16 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] Lock "cinder-quobyte-c166248b-ab58-4cff-9c10-b69c258393f0" released by "delete_volume" :: held 1.252s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:16 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=60,cinder:UPDATE=66,cinder:INSERT=16,cinder:DELETE=6 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:44:16 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=63,cinder:INSERT=14,cinder:UPDATE=72,cinder:DELETE=7 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:44:16 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] Created reservations ['bc9e4c95-37a0-48a5-9631-494cd6edd7c2', 'a2cd2bfb-249c-4d11-b655-b9117486c7b5', '79fd2148-95ad-47e8-8ec4-7bb909562714', 'a2a074cc-2968-4485-945f-c70d2ca86fe3'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:44:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:44:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:44:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:16 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:44:16 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:17 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.339s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:17 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:44:17 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] Deleted volume successfully. Sep 23 12:44:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-defb6228-6358-40eb-a5b8-6cb0afcd583b tempest-VolumesGetTest-293676142 None] Lock "cinder-c166248b-ab58-4cff-9c10-b69c258393f0-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:19 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:44:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Flow 'volume_create_manager' (ae24d5ce-5ca4-408f-b435-b0dcbbca16d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:44:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33378ae6-9536-42d9-b1d0-9c00f27db008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33378ae6-9536-42d9-b1d0-9c00f27db008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1045493272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9254f4d2-4aa0-4de3-a119-3c5375aaf35d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='80b273046366496ba921661e81f7e0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:44:19Z,use_quota=True,user_id='af6b8fb1b4fa4021ab68c54c012116c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bfb6a6b-4240-489e-a1f8-0cdac56368f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bfb6a6b-4240-489e-a1f8-0cdac56368f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd72faa-e8b3-490f-ba14-69a81e6cb911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:19 devstack cinder-volume[86085]: DEBUG cinder.image.glance [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Creating Keystone auth plugin from conf {{(pid=86085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 12:44:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd72faa-e8b3-490f-ba14-69a81e6cb911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9254f4d2-4aa0-4de3-a119-3c5375aaf35d', 'volume_name': 'volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d', 'volume_size': 1, 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3c5121b794a4715babb77a8b7da12a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'created_at': datetime.datetime(2026, 9, 23, 10, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 27, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a62de8e-b7a6-470d-9d46-01abe9647e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a62de8e-b7a6-470d-9d46-01abe9647e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c85ef3-dffc-43a5-913d-091c3578c643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:19 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Volume 9254f4d2-4aa0-4de3-a119-3c5375aaf35d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d', 'volume_size': 1, 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3c5121b794a4715babb77a8b7da12a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'created_at': datetime.datetime(2026, 9, 23, 10, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 27, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 12:44:19 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Trying to clone 9254f4d2-4aa0-4de3-a119-3c5375aaf35d from image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]). {{(pid=86085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 12:44:20 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_ibpu75xsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 12:44:20 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Image download 20.69 MB at 20.69 MB/s Sep 23 12:44:20 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9caf6f6-9681-4bda-9e8f-ec5c382f1679]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:44:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_ibpu75xsdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:20 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_ibpu75xsdevstack@QuobyteHD Sep 23 12:44:20 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:20 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_ibpu75xsdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:20 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Temporary image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 is fetched for user af6b8fb1b4fa4021ab68c54c012116c7. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 12:44:20 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[983289aa-6f4a-4837-b6ed-c05a6d221060]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:44:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_ibpu75xsdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:20 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_ibpu75xsdevstack@QuobyteHD Sep 23 12:44:20 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:21 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_ibpu75xsdevstack@QuobyteHD" returned: 0 in 0.508s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1045493272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9254f4d2-4aa0-4de3-a119-3c5375aaf35d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='80b273046366496ba921661e81f7e0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:44:19Z,use_quota=True,user_id='af6b8fb1b4fa4021ab68c54c012116c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:44:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Creating volume 9254f4d2-4aa0-4de3-a119-3c5375aaf35d {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:44:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:44:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:44:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:44:21 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:44:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:21 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d 1073741824 Sep 23 12:44:21 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:21 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d 1073741824" returned: 0 in 0.658s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:21 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d Sep 23 12:44:21 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:22 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d" returned: 0 in 0.292s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:44:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:22 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Attempting download of 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}])) to volume 9254f4d2-4aa0-4de3-a119-3c5375aaf35d. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 12:44:22 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a6fd62-c7ec-4da9-8727-c6e3dd0d67e2]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:44:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_1rhbw__6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:22 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_1rhbw__6 Sep 23 12:44:22 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:22 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_1rhbw__6" returned: 0 in 0.398s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_1rhbw__6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:22 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_1rhbw__6 Sep 23 12:44:22 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:23 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_1rhbw__6" returned: 1 in 0.383s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_1rhbw__6' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:44:23 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a589c6-bcd0-46a6-a744-fd2c455c1a8b]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:44:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_ibpu75xsdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:23 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_ibpu75xsdevstack@QuobyteHD Sep 23 12:44:23 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:23 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_ibpu75xsdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:23 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 was qcow2, converting to qcow2 {{(pid=86085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 12:44:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_ibpu75xsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:23 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_ibpu75xsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d Sep 23 12:44:23 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:26 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_ibpu75xsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d" returned: 0 in 2.635s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:26 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_ibpu75xsdevstack@QuobyteHD, size 112.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:44:26 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Converted 112.00 MB image at 42.49 MB/s Sep 23 12:44:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:26 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d 1G Sep 23 12:44:26 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:26 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d 1G" returned: 0 in 0.554s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:26 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Downloaded image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}])) to volume 9254f4d2-4aa0-4de3-a119-3c5375aaf35d successfully. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 12:44:26 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Temporary image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 for user af6b8fb1b4fa4021ab68c54c012116c7 is deleted. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 12:44:26 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Marking volume 9254f4d2-4aa0-4de3-a119-3c5375aaf35d as bootable. {{(pid=86085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 12:44:26 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Copying metadata from image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 to 9254f4d2-4aa0-4de3-a119-3c5375aaf35d. {{(pid=86085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 12:44:26 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Creating volume glance metadata for volume 9254f4d2-4aa0-4de3-a119-3c5375aaf35d backed by image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 12:44:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c85ef3-dffc-43a5-913d-091c3578c643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d', 'volume_size': 1, 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3c5121b794a4715babb77a8b7da12a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'created_at': datetime.datetime(2026, 9, 23, 10, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 27, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea95e65-bf28-4d9e-af7f-41c7682370c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:27 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Volume volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d (9254f4d2-4aa0-4de3-a119-3c5375aaf35d): created successfully Sep 23 12:44:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea95e65-bf28-4d9e-af7f-41c7682370c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Flow 'volume_create_manager' (ae24d5ce-5ca4-408f-b435-b0dcbbca16d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:44:27 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-4f84f192-5c14-4dc0-ba33-7a9286029726 tempest-VolumesGetTest-293676142 None] Created volume successfully. Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Flow 'volume_create_manager' (c24faba2-ed35-4ee3-b10a-45e2efb6db27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5c0976-1e78-4cd0-a8cf-5290f79d76cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5c0976-1e78-4cd0-a8cf-5290f79d76cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:44:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1128076174',display_name='tempest-VolumesGetTest-Volume-2116048736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e408afa5-8617-4fca-b2ef-92ca9fc63b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b273046366496ba921661e81f7e0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:44:29Z,use_quota=True,user_id='af6b8fb1b4fa4021ab68c54c012116c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01bc1369-2cf2-44e6-8f95-da1b794ed9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01bc1369-2cf2-44e6-8f95-da1b794ed9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0b9840-afec-497d-a5b2-a67219ef9b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0b9840-afec-497d-a5b2-a67219ef9b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e408afa5-8617-4fca-b2ef-92ca9fc63b55', 'volume_name': 'volume-e408afa5-8617-4fca-b2ef-92ca9fc63b55', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfd7042-c4ed-4f41-9a2f-b5c1fd6f2b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfd7042-c4ed-4f41-9a2f-b5c1fd6f2b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffeff9a1-9e31-4598-a769-613da9b6fb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:28 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Volume e408afa5-8617-4fca-b2ef-92ca9fc63b55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e408afa5-8617-4fca-b2ef-92ca9fc63b55', 'volume_size': 1} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:44:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1128076174',display_name='tempest-VolumesGetTest-Volume-2116048736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e408afa5-8617-4fca-b2ef-92ca9fc63b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b273046366496ba921661e81f7e0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:44:29Z,use_quota=True,user_id='af6b8fb1b4fa4021ab68c54c012116c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Creating volume e408afa5-8617-4fca-b2ef-92ca9fc63b55 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:44:28 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:44:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e408afa5-8617-4fca-b2ef-92ca9fc63b55 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:28 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e408afa5-8617-4fca-b2ef-92ca9fc63b55 1073741824 Sep 23 12:44:28 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:29 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e408afa5-8617-4fca-b2ef-92ca9fc63b55 1073741824" returned: 0 in 0.583s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e408afa5-8617-4fca-b2ef-92ca9fc63b55 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:29 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e408afa5-8617-4fca-b2ef-92ca9fc63b55 Sep 23 12:44:29 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:29 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-e1d12777-8960-49ba-b35d-cfe3e274ea68 req-0e75d369-e6cb-44a5-8f89-949709df5568 tempest-TestMinimumBasicScenario-1511788017 None] Terminate volume connection completed successfully. Sep 23 12:44:29 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-e1d12777-8960-49ba-b35d-cfe3e274ea68 req-0e75d369-e6cb-44a5-8f89-949709df5568 tempest-TestMinimumBasicScenario-1511788017 None] Deleting attachment ef763dc1-75b4-4715-83a8-a227c30f975f. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:44:29 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e408afa5-8617-4fca-b2ef-92ca9fc63b55" returned: 0 in 0.427s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:29 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:44:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffeff9a1-9e31-4598-a769-613da9b6fb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e408afa5-8617-4fca-b2ef-92ca9fc63b55', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce96542-17d1-437c-9a08-f29915f4f0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:30 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Volume volume-e408afa5-8617-4fca-b2ef-92ca9fc63b55 (e408afa5-8617-4fca-b2ef-92ca9fc63b55): created successfully Sep 23 12:44:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce96542-17d1-437c-9a08-f29915f4f0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Flow 'volume_create_manager' (c24faba2-ed35-4ee3-b10a-45e2efb6db27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:44:30 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f70d5b61-b755-41b9-937a-150ace85ceb4 tempest-VolumesGetTest-293676142 None] Created volume successfully. Sep 23 12:44:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] Acquiring lock "cinder-13b953b4-b3aa-4f62-a481-1b78b340cd01-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] Lock "cinder-13b953b4-b3aa-4f62-a481-1b78b340cd01-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] Acquiring lock "cinder-quobyte-13b953b4-b3aa-4f62-a481-1b78b340cd01" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] Lock "cinder-quobyte-13b953b4-b3aa-4f62-a481-1b78b340cd01" acquired by "delete_volume" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:30 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd05394c-15e3-4e4d-aa81-52ce6ada79ca]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:44:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-13b953b4-b3aa-4f62-a481-1b78b340cd01 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:31 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-13b953b4-b3aa-4f62-a481-1b78b340cd01 Sep 23 12:44:31 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] Acquiring lock "cinder-e408afa5-8617-4fca-b2ef-92ca9fc63b55-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] Lock "cinder-e408afa5-8617-4fca-b2ef-92ca9fc63b55-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] Acquiring lock "cinder-quobyte-e408afa5-8617-4fca-b2ef-92ca9fc63b55" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:31 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-13b953b4-b3aa-4f62-a481-1b78b340cd01" returned: 0 in 0.781s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-13b953b4-b3aa-4f62-a481-1b78b340cd01 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] Lock "cinder-quobyte-e408afa5-8617-4fca-b2ef-92ca9fc63b55" acquired by "delete_volume" :: waited 0.087s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:31 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-13b953b4-b3aa-4f62-a481-1b78b340cd01 Sep 23 12:44:31 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:31 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7175172e-70bf-4687-aaea-ea9c5ab103aa]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:44:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e408afa5-8617-4fca-b2ef-92ca9fc63b55 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:31 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e408afa5-8617-4fca-b2ef-92ca9fc63b55 Sep 23 12:44:31 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:32 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-13b953b4-b3aa-4f62-a481-1b78b340cd01" returned: 0 in 0.665s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] Lock "cinder-quobyte-13b953b4-b3aa-4f62-a481-1b78b340cd01" released by "delete_volume" :: held 1.615s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:32 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] Created reservations ['3929061d-601a-4801-8b5b-d97c6bb2a5ef', 'a7412898-354e-4c7a-bcd9-1b21ecd90eb1', 'b4813f3f-aad1-44d7-94b4-34a1507a7a32', 'c0d6cc8c-8368-4f4e-9cde-18ed3b16dd6e'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:44:32 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e408afa5-8617-4fca-b2ef-92ca9fc63b55" returned: 0 in 0.750s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e408afa5-8617-4fca-b2ef-92ca9fc63b55 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:32 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e408afa5-8617-4fca-b2ef-92ca9fc63b55 Sep 23 12:44:32 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:44:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:44:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:32 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:44:32 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] Acquiring lock "cinder-57c13646-0593-4a99-965d-d5ae780480b2-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] Lock "cinder-57c13646-0593-4a99-965d-d5ae780480b2-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] Acquiring lock "cinder-quobyte-57c13646-0593-4a99-965d-d5ae780480b2" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] Lock "cinder-quobyte-57c13646-0593-4a99-965d-d5ae780480b2" acquired by "delete_volume" :: waited 0.023s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:32 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[32328739-3361-457a-9353-545b9cb02987]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:44:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c13646-0593-4a99-965d-d5ae780480b2 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:32 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e408afa5-8617-4fca-b2ef-92ca9fc63b55" returned: 0 in 0.430s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] Lock "cinder-quobyte-e408afa5-8617-4fca-b2ef-92ca9fc63b55" released by "delete_volume" :: held 1.271s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:33 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.504s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:33 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:44:33 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c13646-0593-4a99-965d-d5ae780480b2 Sep 23 12:44:33 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:33 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] Deleted volume successfully. Sep 23 12:44:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-833437c8-24d5-4df6-adca-7763531ded60 tempest-TestMinimumBasicScenario-1511788017 None] Lock "cinder-13b953b4-b3aa-4f62-a481-1b78b340cd01-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:33 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] Created reservations ['4ce7b202-895f-4d88-9d38-03f6766a0128', '3c79bf37-a579-4164-a63c-94ffa030ce7d', 'e17112a8-e8ff-4bf0-b078-daa8b6293c85', '015962f8-081a-4775-8fd0-367731f7cfa9'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:44:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:44:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:44:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:33 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:44:33 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:33 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c13646-0593-4a99-965d-d5ae780480b2" returned: 0 in 0.825s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c13646-0593-4a99-965d-d5ae780480b2 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:33 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c13646-0593-4a99-965d-d5ae780480b2 Sep 23 12:44:33 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:34 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.678s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:34 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:44:34 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] Deleted volume successfully. Sep 23 12:44:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-de824e12-0f22-43a1-a380-a17eae5aa0e3 tempest-VolumesGetTest-293676142 None] Lock "cinder-e408afa5-8617-4fca-b2ef-92ca9fc63b55-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] Acquiring lock "cinder-9254f4d2-4aa0-4de3-a119-3c5375aaf35d-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] Lock "cinder-9254f4d2-4aa0-4de3-a119-3c5375aaf35d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] Acquiring lock "cinder-quobyte-9254f4d2-4aa0-4de3-a119-3c5375aaf35d" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] Lock "cinder-quobyte-9254f4d2-4aa0-4de3-a119-3c5375aaf35d" acquired by "delete_volume" :: waited 0.034s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:34 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[30026c0e-63eb-4826-92c2-e9613c569cd5]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:44:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:34 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c13646-0593-4a99-965d-d5ae780480b2" returned: 0 in 0.902s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] Lock "cinder-quobyte-57c13646-0593-4a99-965d-d5ae780480b2" released by "delete_volume" :: held 1.839s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:34 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] Created reservations ['88139949-6033-455f-8026-31755a5effa2', '5d5d7d6d-2d92-43af-827b-c2cc3e739855', '1c138a6b-36c6-4e71-881a-b2af1bbf7ca6', '5d2ecc07-3fcf-46f3-91b3-ffa01532f0a5'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:44:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:44:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:44:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:34 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d Sep 23 12:44:34 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:35 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:44:35 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:35 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.518s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:35 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:44:35 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] Deleted volume successfully. Sep 23 12:44:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8394b0a2-fcca-40a7-bab5-9d7cd95104ea tempest-VolumesNegativeTest-367888209 None] Lock "cinder-57c13646-0593-4a99-965d-d5ae780480b2-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:35 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d" returned: 0 in 1.402s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:36 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d Sep 23 12:44:36 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:36 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9254f4d2-4aa0-4de3-a119-3c5375aaf35d" returned: 0 in 0.680s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] Lock "cinder-quobyte-9254f4d2-4aa0-4de3-a119-3c5375aaf35d" released by "delete_volume" :: held 2.232s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:36 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] Created reservations ['5bd4b6b8-62cd-4290-8c42-ab2b08966df6', '18e93f7a-89e7-4558-ad42-9e70f17b19c9', 'c070d5d8-39f3-46b0-bc3b-8ccfeed9699e', '148c1cf0-f550-49eb-8595-c1b66eb7dace'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:44:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:44:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:44:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:36 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:44:36 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:37 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.405s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:37 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:44:37 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] Deleted volume successfully. Sep 23 12:44:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-afb92bac-1a1a-4cc5-965b-560d7b87444c tempest-VolumesGetTest-293676142 None] Lock "cinder-9254f4d2-4aa0-4de3-a119-3c5375aaf35d-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:44:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:44:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:44:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:41 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:44:41 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:41 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.496s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:41 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:44:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:44:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:44:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Flow 'volume_create_manager' (936a0d90-72de-410f-a541-84cd6cc07f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de65683c-dec1-4385-b3b0-8b33d8f911dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de65683c-dec1-4385-b3b0-8b33d8f911dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-973283626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6131832f-57f7-496c-9107-1c0026c3c1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa24009ef034aa9932093a942339a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:44:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:44:42Z,use_quota=True,user_id='cbf61df02d0245e89671fa5f20e324ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3bb199-a161-42c2-8e9a-352c3cdeaf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3bb199-a161-42c2-8e9a-352c3cdeaf12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc679a6-ab4c-4446-829c-32917e2a3f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc679a6-ab4c-4446-829c-32917e2a3f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6131832f-57f7-496c-9107-1c0026c3c1f0', 'volume_name': 'volume-6131832f-57f7-496c-9107-1c0026c3c1f0', 'volume_size': 2}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4db080d-c392-4a1c-a6fb-89e6fa89197f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4db080d-c392-4a1c-a6fb-89e6fa89197f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c597beb4-8768-4da5-9e2f-2d0e160caa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:42 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Volume 6131832f-57f7-496c-9107-1c0026c3c1f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6131832f-57f7-496c-9107-1c0026c3c1f0', 'volume_size': 2} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-973283626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6131832f-57f7-496c-9107-1c0026c3c1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa24009ef034aa9932093a942339a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:44:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:44:42Z,use_quota=True,user_id='cbf61df02d0245e89671fa5f20e324ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Creating volume 6131832f-57f7-496c-9107-1c0026c3c1f0 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:44:42 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:44:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0 2147483648 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:42 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0 2147483648 Sep 23 12:44:42 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:43 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0 2147483648" returned: 0 in 0.768s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:43 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0 Sep 23 12:44:43 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:43 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0" returned: 0 in 0.471s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:44:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c597beb4-8768-4da5-9e2f-2d0e160caa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6131832f-57f7-496c-9107-1c0026c3c1f0', 'volume_size': 2}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974ee160-0b46-4d84-bb5f-46473f615d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:43 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Volume volume-6131832f-57f7-496c-9107-1c0026c3c1f0 (6131832f-57f7-496c-9107-1c0026c3c1f0): created successfully Sep 23 12:44:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974ee160-0b46-4d84-bb5f-46473f615d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Flow 'volume_create_manager' (936a0d90-72de-410f-a541-84cd6cc07f9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:44:43 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-dce51615-419b-4d99-b356-b4a852143ffb tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Created volume successfully. Sep 23 12:44:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8aa382bb-ef45-419f-a8ad-dab519297c9a tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8aa382bb-ef45-419f-a8ad-dab519297c9a tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:44 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-8aa382bb-ef45-419f-a8ad-dab519297c9a tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Creating offline snapshot cbde8c20-ce45-4606-8774-3ee946907097 of volume 6131832f-57f7-496c-9107-1c0026c3c1f0 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:44:44 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e341f683-dca4-4632-a685-8e60c14720c3]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:44:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8aa382bb-ef45-419f-a8ad-dab519297c9a tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:44 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0 Sep 23 12:44:44 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:45 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8aa382bb-ef45-419f-a8ad-dab519297c9a tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0" returned: 0 in 0.597s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8aa382bb-ef45-419f-a8ad-dab519297c9a tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097 2G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:45 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097 2G Sep 23 12:44:45 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:45 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8aa382bb-ef45-419f-a8ad-dab519297c9a tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097 2G" returned: 0 in 0.615s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8aa382bb-ef45-419f-a8ad-dab519297c9a tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6131832f-57f7-496c-9107-1c0026c3c1f0 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:45 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6131832f-57f7-496c-9107-1c0026c3c1f0 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097 Sep 23 12:44:45 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:46 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8aa382bb-ef45-419f-a8ad-dab519297c9a tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6131832f-57f7-496c-9107-1c0026c3c1f0 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097" returned: 0 in 0.486s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:46 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-8aa382bb-ef45-419f-a8ad-dab519297c9a tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097 is being set with open permissions: ugo+rw Sep 23 12:44:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8aa382bb-ef45-419f-a8ad-dab519297c9a tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:46 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097 Sep 23 12:44:46 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:46 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8aa382bb-ef45-419f-a8ad-dab519297c9a tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097" returned: 0 in 0.292s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8aa382bb-ef45-419f-a8ad-dab519297c9a tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:46 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.info Sep 23 12:44:46 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:47 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8aa382bb-ef45-419f-a8ad-dab519297c9a tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.info" returned: 0 in 0.313s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:47 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-8aa382bb-ef45-419f-a8ad-dab519297c9a tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.info is being set with open permissions: ugo+rw Sep 23 12:44:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8aa382bb-ef45-419f-a8ad-dab519297c9a tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:47 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.info Sep 23 12:44:47 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:47 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8aa382bb-ef45-419f-a8ad-dab519297c9a tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.info" returned: 0 in 0.311s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8aa382bb-ef45-419f-a8ad-dab519297c9a tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.735s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:47 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-8aa382bb-ef45-419f-a8ad-dab519297c9a tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Create snapshot completed successfully Sep 23 12:44:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Acquiring lock "cinder-cbde8c20-ce45-4606-8774-3ee946907097-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Lock "cinder-cbde8c20-ce45-4606-8774-3ee946907097-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Acquiring lock "cinder-quobyte-6131832f-57f7-496c-9107-1c0026c3c1f0" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Lock "cinder-quobyte-6131832f-57f7-496c-9107-1c0026c3c1f0" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Acquiring lock "cinder-quobyte-cbde8c20-ce45-4606-8774-3ee946907097" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Lock "cinder-quobyte-cbde8c20-ce45-4606-8774-3ee946907097" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Deleting offline snapshot cbde8c20-ce45-4606-8774-3ee946907097 of volume 6131832f-57f7-496c-9107-1c0026c3c1f0 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:44:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] snapshot_file for this snap is: volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:44:48 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adcf62c-42f6-4be2-aef8-178e8812a41f]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:44:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:48 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097 Sep 23 12:44:48 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:48 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097" returned: 0 in 0.455s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6131832f-57f7-496c-9107-1c0026c3c1f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:44:48 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dcdd4d-0266-4ea0-a0c9-c08a456c2aba]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:44:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:48 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0 Sep 23 12:44:48 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:49 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0" returned: 0 in 0.478s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:49 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097 Sep 23 12:44:49 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:49 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097" returned: 0 in 0.372s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:49 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097 Sep 23 12:44:49 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:49 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0.cbde8c20-ce45-4606-8774-3ee946907097" returned: 0 in 0.285s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:49 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Lock "cinder-quobyte-cbde8c20-ce45-4606-8774-3ee946907097" released by "_delete_snapshot" :: held 1.766s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:49 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Lock "cinder-quobyte-6131832f-57f7-496c-9107-1c0026c3c1f0" released by "delete_snapshot" :: held 1.799s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:49 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Created reservations ['4bc09d2d-5050-4875-8b40-40b6ce6b01d6', 'e46704e8-a2d9-4684-91ed-684a54f4449e', 'b75228bb-cacf-4274-8a3f-81b56fdb36f1', '8b758e69-f4cc-4f97-8d3f-d58f14729702'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:44:49 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Delete snapshot completed successfully. Sep 23 12:44:49 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d242ec55-b492-4c4e-ad97-ab0e0d2835dd tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Lock "cinder-cbde8c20-ce45-4606-8774-3ee946907097-delete_snapshot" released by "delete_snapshot" :: held 1.982s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Acquiring lock "cinder-6131832f-57f7-496c-9107-1c0026c3c1f0-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Lock "cinder-6131832f-57f7-496c-9107-1c0026c3c1f0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Acquiring lock "cinder-quobyte-6131832f-57f7-496c-9107-1c0026c3c1f0" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:44:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Lock "cinder-quobyte-6131832f-57f7-496c-9107-1c0026c3c1f0" acquired by "delete_volume" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:44:50 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[175d1e9c-bc2b-44be-be9c-cd3e10700e72]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:44:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:50 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0 Sep 23 12:44:50 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:50 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0" returned: 0 in 0.399s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:50 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0 Sep 23 12:44:50 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6131832f-57f7-496c-9107-1c0026c3c1f0" returned: 0 in 0.311s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:51 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Lock "cinder-quobyte-6131832f-57f7-496c-9107-1c0026c3c1f0" released by "delete_volume" :: held 0.809s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:51 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Created reservations ['7e628995-cae8-4bdc-b502-8030f463d3d5', 'b594ef73-2f0b-4a2e-9e7c-32482f386ba8', '846f5731-2394-433f-8ff6-d958abe4f717', '2e754ef9-8226-4659-83f2-94347a0702d4'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:44:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:44:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:44:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:51 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:44:51 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:51 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.275s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:51 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:44:51 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Deleted volume successfully. Sep 23 12:44:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0982e9de-1953-4ec3-998a-42acb66aff87 tempest-VolumesSnapshotNegativeTestJSON-1046867886 None] Lock "cinder-6131832f-57f7-496c-9107-1c0026c3c1f0-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Flow 'volume_create_manager' (56707688-3697-41cc-a101-39808acf7fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a1e04d4-6a94-4636-8980-bc7ab22edbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a1e04d4-6a94-4636-8980-bc7ab22edbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1391614272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5690b34a-255a-4ae6-94ad-722e32b735bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f0b6e3cc164f6a8f72dfc78a5aefca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:44:57Z,use_quota=True,user_id='6e400c820bae47b8a8a0d0eab735973e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81743c7-5b67-4bcf-b517-fb2ff33b2c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81743c7-5b67-4bcf-b517-fb2ff33b2c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575a45f9-9769-462b-8c9d-d12fee7e084f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575a45f9-9769-462b-8c9d-d12fee7e084f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5690b34a-255a-4ae6-94ad-722e32b735bc', 'volume_name': 'volume-5690b34a-255a-4ae6-94ad-722e32b735bc', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd68ebdd-acfe-4769-8dff-be0d8e81748b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd68ebdd-acfe-4769-8dff-be0d8e81748b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff61d1b-66bd-4a14-b6a9-22b939cb1508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:57 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Volume 5690b34a-255a-4ae6-94ad-722e32b735bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5690b34a-255a-4ae6-94ad-722e32b735bc', 'volume_size': 1} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1391614272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5690b34a-255a-4ae6-94ad-722e32b735bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f0b6e3cc164f6a8f72dfc78a5aefca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:44:57Z,use_quota=True,user_id='6e400c820bae47b8a8a0d0eab735973e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Creating volume 5690b34a-255a-4ae6-94ad-722e32b735bc {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:44:57 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:57 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc 1073741824 Sep 23 12:44:57 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:57 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc 1073741824" returned: 0 in 0.605s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:58 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc Sep 23 12:44:58 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:58 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc" returned: 0 in 0.349s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff61d1b-66bd-4a14-b6a9-22b939cb1508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5690b34a-255a-4ae6-94ad-722e32b735bc', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2abe04f9-4c46-48bb-bec7-59d584012ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:58 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Volume volume-5690b34a-255a-4ae6-94ad-722e32b735bc (5690b34a-255a-4ae6-94ad-722e32b735bc): created successfully Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2abe04f9-4c46-48bb-bec7-59d584012ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Flow 'volume_create_manager' (56707688-3697-41cc-a101-39808acf7fe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:44:58 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-031edd77-398b-4575-a5f8-d664940e15f2 tempest-VolumesSnapshotTestJSON-1315847500 None] Created volume successfully. Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Flow 'volume_create_manager' (4c8b5d1f-b84a-48f9-8a03-5c4b1bf1fa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baba276b-db89-47dd-a660-0181677d7133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baba276b-db89-47dd-a660-0181677d7133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1602862690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35668df1-8c55-4f8f-9984-15297d8ddcf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a27c60a3fa48e892c4ee187c434d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:44:59Z,use_quota=True,user_id='7fdb6ee9a58c408894fb22973e89c3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29af42d0-f6f6-48e3-8cf0-4228242071a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29af42d0-f6f6-48e3-8cf0-4228242071a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a019f68-bf01-42b3-b69f-e8c34aefa64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a019f68-bf01-42b3-b69f-e8c34aefa64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35668df1-8c55-4f8f-9984-15297d8ddcf9', 'volume_name': 'volume-35668df1-8c55-4f8f-9984-15297d8ddcf9', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372bcb85-e563-40ab-8135-6b1d591560cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372bcb85-e563-40ab-8135-6b1d591560cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca80f723-756f-4ceb-8fd4-c3e226aa205b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:44:58 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Volume 35668df1-8c55-4f8f-9984-15297d8ddcf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35668df1-8c55-4f8f-9984-15297d8ddcf9', 'volume_size': 1} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1602862690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35668df1-8c55-4f8f-9984-15297d8ddcf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a27c60a3fa48e892c4ee187c434d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:44:59Z,use_quota=True,user_id='7fdb6ee9a58c408894fb22973e89c3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Creating volume 35668df1-8c55-4f8f-9984-15297d8ddcf9 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:44:58 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:44:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35668df1-8c55-4f8f-9984-15297d8ddcf9 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:58 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35668df1-8c55-4f8f-9984-15297d8ddcf9 1073741824 Sep 23 12:44:58 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:59 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35668df1-8c55-4f8f-9984-15297d8ddcf9 1073741824" returned: 0 in 0.605s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35668df1-8c55-4f8f-9984-15297d8ddcf9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:44:59 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35668df1-8c55-4f8f-9984-15297d8ddcf9 Sep 23 12:44:59 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:44:59 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Sep 23 12:44:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35668df1-8c55-4f8f-9984-15297d8ddcf9" returned: 0 in 0.457s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:44:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:44:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca80f723-756f-4ceb-8fd4-c3e226aa205b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35668df1-8c55-4f8f-9984-15297d8ddcf9', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3773e7e-8853-44ec-b77f-c5f8c53b93b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:00 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Volume volume-35668df1-8c55-4f8f-9984-15297d8ddcf9 (35668df1-8c55-4f8f-9984-15297d8ddcf9): created successfully Sep 23 12:45:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3773e7e-8853-44ec-b77f-c5f8c53b93b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Flow 'volume_create_manager' (4c8b5d1f-b84a-48f9-8a03-5c4b1bf1fa23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:45:00 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-31bfd1b8-49fc-4711-b323-11442e4827d6 tempest-AttachVolumeNegativeTest-321616029 None] Created volume successfully. Sep 23 12:45:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3fc6811a-4dd8-4d9e-ad85-6d77a1ce300b tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3fc6811a-4dd8-4d9e-ad85-6d77a1ce300b tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-3fc6811a-4dd8-4d9e-ad85-6d77a1ce300b tempest-VolumesSnapshotTestJSON-1315847500 None] Creating offline snapshot e6abf4bc-2735-43fd-b16a-78050428cb0c of volume 5690b34a-255a-4ae6-94ad-722e32b735bc {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:45:00 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[73415681-cf47-4fb2-a969-a103acce0f5c]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3fc6811a-4dd8-4d9e-ad85-6d77a1ce300b tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:00 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc Sep 23 12:45:00 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:00 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3fc6811a-4dd8-4d9e-ad85-6d77a1ce300b tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc" returned: 0 in 0.381s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3fc6811a-4dd8-4d9e-ad85-6d77a1ce300b tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:00 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c 1G Sep 23 12:45:00 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:01 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3fc6811a-4dd8-4d9e-ad85-6d77a1ce300b tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c 1G" returned: 0 in 0.607s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3fc6811a-4dd8-4d9e-ad85-6d77a1ce300b tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5690b34a-255a-4ae6-94ad-722e32b735bc -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:01 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5690b34a-255a-4ae6-94ad-722e32b735bc -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c Sep 23 12:45:01 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:01 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3fc6811a-4dd8-4d9e-ad85-6d77a1ce300b tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5690b34a-255a-4ae6-94ad-722e32b735bc -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c" returned: 0 in 0.404s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:01 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-3fc6811a-4dd8-4d9e-ad85-6d77a1ce300b tempest-VolumesSnapshotTestJSON-1315847500 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c is being set with open permissions: ugo+rw Sep 23 12:45:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3fc6811a-4dd8-4d9e-ad85-6d77a1ce300b tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:01 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c Sep 23 12:45:01 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-3b012c4e-5df3-43fb-bc2f-7c68a0607128 req-a4eeeec9-7635-49d4-9d33-69f099152072 tempest-AttachVolumeNegativeTest-321616029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:01 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3fc6811a-4dd8-4d9e-ad85-6d77a1ce300b tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c" returned: 0 in 0.310s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3fc6811a-4dd8-4d9e-ad85-6d77a1ce300b tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:01 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.info Sep 23 12:45:01 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:02 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3fc6811a-4dd8-4d9e-ad85-6d77a1ce300b tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.info" returned: 0 in 0.289s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:02 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-3fc6811a-4dd8-4d9e-ad85-6d77a1ce300b tempest-VolumesSnapshotTestJSON-1315847500 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.info is being set with open permissions: ugo+rw Sep 23 12:45:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3fc6811a-4dd8-4d9e-ad85-6d77a1ce300b tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:02 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.info Sep 23 12:45:02 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:02 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3fc6811a-4dd8-4d9e-ad85-6d77a1ce300b tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.info" returned: 0 in 0.291s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3fc6811a-4dd8-4d9e-ad85-6d77a1ce300b tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-3b012c4e-5df3-43fb-bc2f-7c68a0607128 req-a4eeeec9-7635-49d4-9d33-69f099152072 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.730s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-3b012c4e-5df3-43fb-bc2f-7c68a0607128 req-a4eeeec9-7635-49d4-9d33-69f099152072 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.058s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-3b012c4e-5df3-43fb-bc2f-7c68a0607128 req-a4eeeec9-7635-49d4-9d33-69f099152072 tempest-AttachVolumeNegativeTest-321616029 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-35668df1-8c55-4f8f-9984-15297d8ddcf9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f094bcd-097a-4292-aa62-c8d176250a52', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:45:02 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-3fc6811a-4dd8-4d9e-ad85-6d77a1ce300b tempest-VolumesSnapshotTestJSON-1315847500 None] Create snapshot completed successfully Sep 23 12:45:02 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-3b012c4e-5df3-43fb-bc2f-7c68a0607128 req-a4eeeec9-7635-49d4-9d33-69f099152072 tempest-AttachVolumeNegativeTest-321616029 None] attachment_update completed successfully. Sep 23 12:45:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-e6abf4bc-2735-43fd-b16a-78050428cb0c-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-e6abf4bc-2735-43fd-b16a-78050428cb0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-quobyte-5690b34a-255a-4ae6-94ad-722e32b735bc" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-5690b34a-255a-4ae6-94ad-722e32b735bc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-quobyte-e6abf4bc-2735-43fd-b16a-78050428cb0c" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-e6abf4bc-2735-43fd-b16a-78050428cb0c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] Deleting offline snapshot e6abf4bc-2735-43fd-b16a-78050428cb0c of volume 5690b34a-255a-4ae6-94ad-722e32b735bc {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:45:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] snapshot_file for this snap is: volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:45:03 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c3526e-2668-4662-ad35-e062893e0607]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:03 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c Sep 23 12:45:03 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:04 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c" returned: 0 in 0.525s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5690b34a-255a-4ae6-94ad-722e32b735bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:45:04 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f753d5e4-eae0-43a7-a108-13a6587900a9]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:04 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc Sep 23 12:45:04 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:04 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc" returned: 0 in 0.461s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:04 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c Sep 23 12:45:04 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:05 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c" returned: 0 in 0.531s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:05 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c Sep 23 12:45:05 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:05 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc.e6abf4bc-2735-43fd-b16a-78050428cb0c" returned: 0 in 0.400s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:05 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-e6abf4bc-2735-43fd-b16a-78050428cb0c" released by "_delete_snapshot" :: held 2.129s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:05 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-5690b34a-255a-4ae6-94ad-722e32b735bc" released by "delete_snapshot" :: held 2.167s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:05 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] Created reservations ['6d2e734d-4586-4592-aef6-31ed9a8e05dd', 'b03b1f9d-53e1-41ff-b00c-a836405c4a4e', '6bd8110c-4f54-40e2-bfca-2abb1105901f', 'fc5a0806-5c30-4d69-94ef-8c1964f4d4c0'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:45:05 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] Delete snapshot completed successfully. Sep 23 12:45:05 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-979da642-6f7d-42c5-947a-14024623562d tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-e6abf4bc-2735-43fd-b16a-78050428cb0c-delete_snapshot" released by "delete_snapshot" :: held 2.432s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:05 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-1c16cdd9-8864-422c-aaa1-274424944256 req-0d1012a6-5059-4ba6-a3bd-67415781385f tempest-AttachVolumeNegativeTest-321616029 None] Terminate volume connection completed successfully. Sep 23 12:45:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-1c16cdd9-8864-422c-aaa1-274424944256 req-0d1012a6-5059-4ba6-a3bd-67415781385f tempest-AttachVolumeNegativeTest-321616029 None] Deleting attachment 1f094bcd-097a-4292-aa62-c8d176250a52. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Flow 'volume_create_manager' (1ce259c2-86e9-47ef-94b7-4aa4bef5aef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f9bdc1-e9ae-49fd-b07a-484dfd22f36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f9bdc1-e9ae-49fd-b07a-484dfd22f36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-39137946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fce0bc-c885-4ea4-b6ed-465b9cb4779f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f0b6e3cc164f6a8f72dfc78a5aefca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:45:08Z,use_quota=True,user_id='6e400c820bae47b8a8a0d0eab735973e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37f43b1-a361-44b6-879b-a16224fcbc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37f43b1-a361-44b6-879b-a16224fcbc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e02a7d8-caff-453f-82c9-5c44e93e357c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e02a7d8-caff-453f-82c9-5c44e93e357c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9fce0bc-c885-4ea4-b6ed-465b9cb4779f', 'volume_name': 'volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec9880d-30ff-4c50-b84e-c6dc37e7bfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec9880d-30ff-4c50-b84e-c6dc37e7bfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecea9ec-f191-49a0-bd59-694f016d1d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:07 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Volume f9fce0bc-c885-4ea4-b6ed-465b9cb4779f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f', 'volume_size': 1} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-39137946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fce0bc-c885-4ea4-b6ed-465b9cb4779f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f0b6e3cc164f6a8f72dfc78a5aefca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:45:08Z,use_quota=True,user_id='6e400c820bae47b8a8a0d0eab735973e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Creating volume f9fce0bc-c885-4ea4-b6ed-465b9cb4779f {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:45:07 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:45:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:07 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f 1073741824 Sep 23 12:45:07 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:08 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f 1073741824" returned: 0 in 0.576s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:08 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f Sep 23 12:45:08 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:08 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f" returned: 0 in 0.329s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:08 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:45:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecea9ec-f191-49a0-bd59-694f016d1d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88073415-581d-4389-95c6-d41b925a9f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:08 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Volume volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f (f9fce0bc-c885-4ea4-b6ed-465b9cb4779f): created successfully Sep 23 12:45:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88073415-581d-4389-95c6-d41b925a9f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:08 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Flow 'volume_create_manager' (1ce259c2-86e9-47ef-94b7-4aa4bef5aef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:45:08 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-49e8485c-202c-4594-a213-c369586ea5bb tempest-VolumesSnapshotTestJSON-1315847500 None] Created volume successfully. Sep 23 12:45:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-31226796-9f18-4b91-9081-2d057171e04b tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-31226796-9f18-4b91-9081-2d057171e04b tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:10 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-31226796-9f18-4b91-9081-2d057171e04b tempest-VolumesSnapshotTestJSON-1315847500 None] Creating offline snapshot 6fcaa014-7086-4775-a6c2-df2a3b751b1e of volume f9fce0bc-c885-4ea4-b6ed-465b9cb4779f {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:45:10 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[92032725-3073-4514-8a49-2ee2c11ae4e1]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31226796-9f18-4b91-9081-2d057171e04b tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:10 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f Sep 23 12:45:10 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:10 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31226796-9f18-4b91-9081-2d057171e04b tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f" returned: 0 in 0.490s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31226796-9f18-4b91-9081-2d057171e04b tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:10 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e 1G Sep 23 12:45:10 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:11 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31226796-9f18-4b91-9081-2d057171e04b tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e 1G" returned: 0 in 0.515s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31226796-9f18-4b91-9081-2d057171e04b tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:11 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e Sep 23 12:45:11 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:11 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31226796-9f18-4b91-9081-2d057171e04b tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e" returned: 0 in 0.470s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:11 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-31226796-9f18-4b91-9081-2d057171e04b tempest-VolumesSnapshotTestJSON-1315847500 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e is being set with open permissions: ugo+rw Sep 23 12:45:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31226796-9f18-4b91-9081-2d057171e04b tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:11 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e Sep 23 12:45:11 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:11 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31226796-9f18-4b91-9081-2d057171e04b tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e" returned: 0 in 0.394s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31226796-9f18-4b91-9081-2d057171e04b tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:12 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.info Sep 23 12:45:12 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:12 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31226796-9f18-4b91-9081-2d057171e04b tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.info" returned: 0 in 0.376s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:12 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-31226796-9f18-4b91-9081-2d057171e04b tempest-VolumesSnapshotTestJSON-1315847500 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.info is being set with open permissions: ugo+rw Sep 23 12:45:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31226796-9f18-4b91-9081-2d057171e04b tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:12 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.info Sep 23 12:45:12 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:12 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-31226796-9f18-4b91-9081-2d057171e04b tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.info" returned: 0 in 0.360s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-31226796-9f18-4b91-9081-2d057171e04b tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.767s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:12 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-31226796-9f18-4b91-9081-2d057171e04b tempest-VolumesSnapshotTestJSON-1315847500 None] Create snapshot completed successfully Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Flow 'volume_create_manager' (8708bce7-4ffb-49e9-be1e-fe09c14b3e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6500aa45-798c-4dad-9de2-cdf7b0b0589f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6500aa45-798c-4dad-9de2-cdf7b0b0589f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1796497184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b566fd55-e660-4127-ba55-5d284119f3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f0b6e3cc164f6a8f72dfc78a5aefca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:45:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6fcaa014-7086-4775-a6c2-df2a3b751b1e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:45:14Z,use_quota=True,user_id='6e400c820bae47b8a8a0d0eab735973e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd399e18-073f-405e-bb4e-c157405b6cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd399e18-073f-405e-bb4e-c157405b6cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17cbcf65-8b7a-4fca-b38a-76dce4039960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17cbcf65-8b7a-4fca-b38a-76dce4039960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b566fd55-e660-4127-ba55-5d284119f3b2', 'volume_name': 'volume-b566fd55-e660-4127-ba55-5d284119f3b2', 'volume_size': 2, 'snapshot_id': '6fcaa014-7086-4775-a6c2-df2a3b751b1e'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a24ae86-13d8-44a7-91d1-c4bc2d7f9c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a24ae86-13d8-44a7-91d1-c4bc2d7f9c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a198553-045c-4164-ad36-afd9414e9b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:14 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Volume b566fd55-e660-4127-ba55-5d284119f3b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b566fd55-e660-4127-ba55-5d284119f3b2', 'volume_size': 2, 'snapshot_id': '6fcaa014-7086-4775-a6c2-df2a3b751b1e'} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-quobyte-6fcaa014-7086-4775-a6c2-df2a3b751b1e-b566fd55-e660-4127-ba55-5d284119f3b2" by "_create_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-6fcaa014-7086-4775-a6c2-df2a3b751b1e-b566fd55-e660-4127-ba55-5d284119f3b2" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Creating volume b566fd55-e660-4127-ba55-5d284119f3b2 from snapshot 6fcaa014-7086-4775-a6c2-df2a3b751b1e {{(pid=86085) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-quobyte-b566fd55-e660-4127-ba55-5d284119f3b2" by "_copy_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-b566fd55-e660-4127-ba55-5d284119f3b2" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] snapshot: 6fcaa014-7086-4775-a6c2-df2a3b751b1e, volume: b566fd55-e660-4127-ba55-5d284119f3b2, {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6449574f-1b02-4991-9334-8512bbc79549]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:14 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e Sep 23 12:45:14 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:14 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e" returned: 0 in 0.471s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9f13a3-08ad-4891-9c13-9c4590347429]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:14 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f Sep 23 12:45:14 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:15 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f" returned: 0 in 0.515s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] will copy from snapshot at /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 12:45:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Creating direct copy from snapshot {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 12:45:15 devstack cinder-volume[86085]: DEBUG cinder.utils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Path /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b566fd55-e660-4127-ba55-5d284119f3b2 not found in is_blk_device check {{(pid=86085) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 12:45:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b566fd55-e660-4127-ba55-5d284119f3b2 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:15 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b566fd55-e660-4127-ba55-5d284119f3b2 Sep 23 12:45:15 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:20 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] Acquiring lock "cinder-35668df1-8c55-4f8f-9984-15297d8ddcf9-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] Lock "cinder-35668df1-8c55-4f8f-9984-15297d8ddcf9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:21 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:UPDATE=85,cinder:SELECT=87,cinder:INSERT=24,cinder:DELETE=8 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:45:21 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=86,cinder:INSERT=30,cinder:UPDATE=87,cinder:DELETE=7 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:45:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] Acquiring lock "cinder-quobyte-35668df1-8c55-4f8f-9984-15297d8ddcf9" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] Lock "cinder-quobyte-35668df1-8c55-4f8f-9984-15297d8ddcf9" acquired by "delete_volume" :: waited 0.037s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:21 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc371dc1-a10d-4c6a-badd-aa2a98764bf3]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35668df1-8c55-4f8f-9984-15297d8ddcf9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:21 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35668df1-8c55-4f8f-9984-15297d8ddcf9 Sep 23 12:45:21 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:22 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35668df1-8c55-4f8f-9984-15297d8ddcf9" returned: 0 in 0.771s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35668df1-8c55-4f8f-9984-15297d8ddcf9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:22 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35668df1-8c55-4f8f-9984-15297d8ddcf9 Sep 23 12:45:22 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:22 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35668df1-8c55-4f8f-9984-15297d8ddcf9" returned: 0 in 0.537s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] Lock "cinder-quobyte-35668df1-8c55-4f8f-9984-15297d8ddcf9" released by "delete_volume" :: held 1.432s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:22 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] Created reservations ['ecfb3f77-8fe6-4e0a-94e7-ba7d3c8ff365', '76851acd-3d2a-4a94-9c6e-2d1a33a1dae2', 'b2fa925d-6399-4a88-b69e-23ad3a843742', 'fa1db7dd-867f-4e33-81f2-c1045569f108'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:45:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:45:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:45:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:22 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:45:22 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:23 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] Acquiring lock "cinder-ae47e218-a435-43c0-bb19-1f3a98a05ae7-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b566fd55-e660-4127-ba55-5d284119f3b2" returned: 0 in 8.356s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:23 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Image conversion details: src /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f, size 1024.00 MB, duration 8.36 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b566fd55-e660-4127-ba55-5d284119f3b2 {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:45:23 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Converted 1024.00 MB image at 122.52 MB/s Sep 23 12:45:23 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b566fd55-e660-4127-ba55-5d284119f3b2 is being set with open permissions: ugo+rw Sep 23 12:45:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b566fd55-e660-4127-ba55-5d284119f3b2 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:23 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b566fd55-e660-4127-ba55-5d284119f3b2 Sep 23 12:45:23 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] Lock "cinder-ae47e218-a435-43c0-bb19-1f3a98a05ae7-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:23 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.932s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:23 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:45:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] Acquiring lock "cinder-quobyte-ae47e218-a435-43c0-bb19-1f3a98a05ae7" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:23 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] Deleted volume successfully. Sep 23 12:45:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] Lock "cinder-quobyte-ae47e218-a435-43c0-bb19-1f3a98a05ae7" acquired by "delete_volume" :: waited 0.106s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6ad5e3cb-e971-465f-baa1-40f730b8de91 tempest-AttachVolumeNegativeTest-321616029 None] Lock "cinder-35668df1-8c55-4f8f-9984-15297d8ddcf9-delete_volume" released by "delete_volume" :: held 3.021s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:24 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde60a4d-5634-4e2d-912c-cf6192d90cd8]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ae47e218-a435-43c0-bb19-1f3a98a05ae7 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:24 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b566fd55-e660-4127-ba55-5d284119f3b2" returned: 0 in 0.470s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-b566fd55-e660-4127-ba55-5d284119f3b2" released by "_copy_volume_from_snapshot" :: held 9.965s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:24 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ae47e218-a435-43c0-bb19-1f3a98a05ae7 Sep 23 12:45:24 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-6fcaa014-7086-4775-a6c2-df2a3b751b1e-b566fd55-e660-4127-ba55-5d284119f3b2" released by "_create_volume_from_snapshot" :: held 10.056s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.076s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a198553-045c-4164-ad36-afd9414e9b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b566fd55-e660-4127-ba55-5d284119f3b2', 'volume_size': 2, 'snapshot_id': '6fcaa014-7086-4775-a6c2-df2a3b751b1e'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f788d08-8702-40a5-aabf-afc5da14825e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:24 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Volume volume-b566fd55-e660-4127-ba55-5d284119f3b2 (b566fd55-e660-4127-ba55-5d284119f3b2): created successfully Sep 23 12:45:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f788d08-8702-40a5-aabf-afc5da14825e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Flow 'volume_create_manager' (8708bce7-4ffb-49e9-be1e-fe09c14b3e1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:45:24 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-56fe65d4-64d4-44ef-ba51-9c6708d7bb8b tempest-VolumesSnapshotTestJSON-1315847500 None] Created volume successfully. Sep 23 12:45:24 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ae47e218-a435-43c0-bb19-1f3a98a05ae7" returned: 0 in 0.487s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ae47e218-a435-43c0-bb19-1f3a98a05ae7 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:24 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ae47e218-a435-43c0-bb19-1f3a98a05ae7 Sep 23 12:45:24 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:24 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ae47e218-a435-43c0-bb19-1f3a98a05ae7" returned: 0 in 0.287s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] Lock "cinder-quobyte-ae47e218-a435-43c0-bb19-1f3a98a05ae7" released by "delete_volume" :: held 0.872s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:24 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] Created reservations ['b7900eeb-af01-4f14-9ff3-85fb56147dad', '38d56725-518b-4319-a7c5-717b52587115', '67d299ba-100d-4f4f-9e1d-867d64eff832', '859ab278-275b-47f1-a2f9-3fdda317a85e'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:45:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:45:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:45:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:25 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:45:25 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-b566fd55-e660-4127-ba55-5d284119f3b2-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-b566fd55-e660-4127-ba55-5d284119f3b2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-quobyte-b566fd55-e660-4127-ba55-5d284119f3b2" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-b566fd55-e660-4127-ba55-5d284119f3b2" acquired by "delete_volume" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:25 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e873fd6-b9a7-49a4-b207-f4b81ee08fdc]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b566fd55-e660-4127-ba55-5d284119f3b2 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:25 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.428s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:25 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:45:25 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] Deleted volume successfully. Sep 23 12:45:25 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b566fd55-e660-4127-ba55-5d284119f3b2 Sep 23 12:45:25 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f65d56b0-a86a-4086-bf3d-1f9031b0aedf tempest-AttachVolumeNegativeTest-321616029 None] Lock "cinder-ae47e218-a435-43c0-bb19-1f3a98a05ae7-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:25 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b566fd55-e660-4127-ba55-5d284119f3b2" returned: 0 in 0.520s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b566fd55-e660-4127-ba55-5d284119f3b2 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:25 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b566fd55-e660-4127-ba55-5d284119f3b2 Sep 23 12:45:25 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:26 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b566fd55-e660-4127-ba55-5d284119f3b2" returned: 0 in 0.350s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] Acquiring lock "cinder-037f50b8-c4be-49c1-b59e-7f86b9b85566-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-b566fd55-e660-4127-ba55-5d284119f3b2" released by "delete_volume" :: held 0.944s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] Lock "cinder-037f50b8-c4be-49c1-b59e-7f86b9b85566-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] Acquiring lock "cinder-quobyte-037f50b8-c4be-49c1-b59e-7f86b9b85566" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:26 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] Created reservations ['591be292-782f-4bd3-8182-4ad83f7337d2', 'ce982a0c-9206-4bd4-b63a-fa7e99ab0dc3', '62ac8858-b654-4e9d-ac29-47a6ac4b4527', '876cc4a2-958e-49b6-b0d8-98d93c5f8ca7'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:45:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] Lock "cinder-quobyte-037f50b8-c4be-49c1-b59e-7f86b9b85566" acquired by "delete_volume" :: waited 0.052s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:26 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc5b003-b402-4342-8add-472466352656]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-037f50b8-c4be-49c1-b59e-7f86b9b85566 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:45:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:45:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:26 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:45:26 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:26 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-037f50b8-c4be-49c1-b59e-7f86b9b85566 Sep 23 12:45:26 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:26 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.318s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:26 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:45:26 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] Deleted volume successfully. Sep 23 12:45:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a8bced8b-d422-4bd9-9af3-353cc81786b4 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-b566fd55-e660-4127-ba55-5d284119f3b2-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:27 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-037f50b8-c4be-49c1-b59e-7f86b9b85566" returned: 0 in 0.602s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-037f50b8-c4be-49c1-b59e-7f86b9b85566 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:27 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-037f50b8-c4be-49c1-b59e-7f86b9b85566 Sep 23 12:45:27 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:27 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-037f50b8-c4be-49c1-b59e-7f86b9b85566" returned: 0 in 0.300s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] Lock "cinder-quobyte-037f50b8-c4be-49c1-b59e-7f86b9b85566" released by "delete_volume" :: held 0.981s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] Created reservations ['eb7be00d-6cb6-4e3a-970d-408391ad393f', '045f5bf6-b30a-425e-9572-ce3f3c6eb607', '4589ed28-8a77-42fd-a77d-0c729b2ae5a8', 'ef91fa58-ca56-4a74-a175-7192c49ff0d3'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:27 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:45:27 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-6fcaa014-7086-4775-a6c2-df2a3b751b1e-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-6fcaa014-7086-4775-a6c2-df2a3b751b1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-quobyte-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-quobyte-6fcaa014-7086-4775-a6c2-df2a3b751b1e" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-6fcaa014-7086-4775-a6c2-df2a3b751b1e" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] Deleting offline snapshot 6fcaa014-7086-4775-a6c2-df2a3b751b1e of volume f9fce0bc-c885-4ea4-b6ed-465b9cb4779f {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] snapshot_file for this snap is: volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5428df-5a55-473a-b651-220637d941c0]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:27 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.359s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:45:27 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] Deleted volume successfully. Sep 23 12:45:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-43fefc2e-a99d-4d46-9e41-96192b2f3543 tempest-AttachVolumeNegativeTest-321616029 None] Lock "cinder-037f50b8-c4be-49c1-b59e-7f86b9b85566-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:28 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e Sep 23 12:45:28 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:28 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e" returned: 0 in 0.519s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:28 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:45:28 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db734c9-7a36-4c17-9bb3-a307823617f7]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:28 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f Sep 23 12:45:28 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:29 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f" returned: 0 in 0.700s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:29 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e Sep 23 12:45:29 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:29 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e" returned: 0 in 0.444s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:29 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e Sep 23 12:45:29 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:29 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f.6fcaa014-7086-4775-a6c2-df2a3b751b1e" returned: 0 in 0.321s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:29 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-6fcaa014-7086-4775-a6c2-df2a3b751b1e" released by "_delete_snapshot" :: held 2.200s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:29 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f" released by "delete_snapshot" :: held 2.242s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:30 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] Created reservations ['df2b9c20-a0f0-419c-8f37-b7b046bae465', 'eab12a45-2f0b-496b-8b7e-80bda9d21801', 'a0215d38-5026-45a8-a96f-f369f05d309e', '2f209c5a-75c8-4222-9ada-4f55be425cf8'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:45:30 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] Delete snapshot completed successfully. Sep 23 12:45:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9f300b8e-2d94-4a24-b5f7-85a2bfc19dec tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-6fcaa014-7086-4775-a6c2-df2a3b751b1e-delete_snapshot" released by "delete_snapshot" :: held 2.429s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-quobyte-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f" acquired by "delete_volume" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:31 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0aca378-392c-4d90-be5a-52abe3ae3067]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:31 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f Sep 23 12:45:31 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:31 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f" returned: 0 in 0.430s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:31 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f Sep 23 12:45:31 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:31 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f" returned: 0 in 0.309s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f" released by "delete_volume" :: held 0.825s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] Created reservations ['a860587f-aba0-437e-84e4-6963072d119c', 'cb39ac79-dd62-4482-90fd-94493bc7cba5', 'e2403a1c-9817-442e-90d5-6e0597a96f21', '4cf00bb0-0708-48f2-a2e3-e6677f9b9951'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:32 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:45:32 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:32 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.300s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:45:32 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] Deleted volume successfully. Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d26ec21f-a58b-4f0f-b997-e8c9e0970b88 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-f9fce0bc-c885-4ea4-b6ed-465b9cb4779f-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Flow 'volume_create_manager' (4833a62f-db4d-474a-a604-f152ff0e1fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d8712a-48a0-4b89-8057-368dc30247de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d8712a-48a0-4b89-8057-368dc30247de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1311590533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f307e4c-a4db-4509-87d1-2037800b4042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f0b6e3cc164f6a8f72dfc78a5aefca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:45:33Z,use_quota=True,user_id='6e400c820bae47b8a8a0d0eab735973e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1caf82e9-7910-4610-8c28-852c43b4e1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1caf82e9-7910-4610-8c28-852c43b4e1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913edfb7-0f89-43fd-bd53-b6adda69ae04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913edfb7-0f89-43fd-bd53-b6adda69ae04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f307e4c-a4db-4509-87d1-2037800b4042', 'volume_name': 'volume-5f307e4c-a4db-4509-87d1-2037800b4042', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8120cd5-d341-4f82-917b-30a455527ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8120cd5-d341-4f82-917b-30a455527ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc97aa0d-e233-45c6-beb0-833bb542f32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:32 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Volume 5f307e4c-a4db-4509-87d1-2037800b4042: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f307e4c-a4db-4509-87d1-2037800b4042', 'volume_size': 1} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1311590533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f307e4c-a4db-4509-87d1-2037800b4042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f0b6e3cc164f6a8f72dfc78a5aefca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:45:33Z,use_quota=True,user_id='6e400c820bae47b8a8a0d0eab735973e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Creating volume 5f307e4c-a4db-4509-87d1-2037800b4042 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:45:32 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:45:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:33 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042 1073741824 Sep 23 12:45:33 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:33 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042 1073741824" returned: 0 in 0.633s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:33 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042 Sep 23 12:45:33 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:33 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042" returned: 0 in 0.338s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:45:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc97aa0d-e233-45c6-beb0-833bb542f32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f307e4c-a4db-4509-87d1-2037800b4042', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6055c6b6-2218-45d3-b040-69fa3c6cb5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:34 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Volume volume-5f307e4c-a4db-4509-87d1-2037800b4042 (5f307e4c-a4db-4509-87d1-2037800b4042): created successfully Sep 23 12:45:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6055c6b6-2218-45d3-b040-69fa3c6cb5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Flow 'volume_create_manager' (4833a62f-db4d-474a-a604-f152ff0e1fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:45:34 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f138f7a8-aead-40f6-9163-bce6fcca3689 tempest-VolumesSnapshotTestJSON-1315847500 None] Created volume successfully. Sep 23 12:45:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0048bb35-1931-47d1-865b-42031d996c08 tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0048bb35-1931-47d1-865b-42031d996c08 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0048bb35-1931-47d1-865b-42031d996c08 tempest-VolumesSnapshotTestJSON-1315847500 None] Creating offline snapshot d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af of volume 5f307e4c-a4db-4509-87d1-2037800b4042 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:45:35 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3214a3c-9aa6-4f08-8c95-3c3df351877f]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0048bb35-1931-47d1-865b-42031d996c08 tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:35 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042 Sep 23 12:45:35 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:35 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0048bb35-1931-47d1-865b-42031d996c08 tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042" returned: 0 in 0.525s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0048bb35-1931-47d1-865b-42031d996c08 tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:35 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af 1G Sep 23 12:45:35 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:36 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0048bb35-1931-47d1-865b-42031d996c08 tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af 1G" returned: 0 in 0.498s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0048bb35-1931-47d1-865b-42031d996c08 tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f307e4c-a4db-4509-87d1-2037800b4042 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:36 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f307e4c-a4db-4509-87d1-2037800b4042 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af Sep 23 12:45:36 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:36 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0048bb35-1931-47d1-865b-42031d996c08 tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f307e4c-a4db-4509-87d1-2037800b4042 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af" returned: 0 in 0.382s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:36 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-0048bb35-1931-47d1-865b-42031d996c08 tempest-VolumesSnapshotTestJSON-1315847500 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af is being set with open permissions: ugo+rw Sep 23 12:45:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0048bb35-1931-47d1-865b-42031d996c08 tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:36 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af Sep 23 12:45:36 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:37 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0048bb35-1931-47d1-865b-42031d996c08 tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af" returned: 0 in 0.527s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0048bb35-1931-47d1-865b-42031d996c08 tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:37 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.info Sep 23 12:45:37 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:37 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0048bb35-1931-47d1-865b-42031d996c08 tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.info" returned: 0 in 0.349s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:37 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-0048bb35-1931-47d1-865b-42031d996c08 tempest-VolumesSnapshotTestJSON-1315847500 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.info is being set with open permissions: ugo+rw Sep 23 12:45:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0048bb35-1931-47d1-865b-42031d996c08 tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:37 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.info Sep 23 12:45:37 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:38 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0048bb35-1931-47d1-865b-42031d996c08 tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.info" returned: 0 in 0.438s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0048bb35-1931-47d1-865b-42031d996c08 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.884s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Flow 'volume_create_manager' (327dc4b8-fa16-4e7f-8743-70de0134f31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1c22c3-b95b-4256-b958-e806344733d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:38 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0048bb35-1931-47d1-865b-42031d996c08 tempest-VolumesSnapshotTestJSON-1315847500 None] Create snapshot completed successfully Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1c22c3-b95b-4256-b958-e806344733d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1120541152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3fe179-7d87-41ef-a5de-a5ca32371558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d01fae3509844e499bcef4cc311d4b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:45:38Z,use_quota=True,user_id='73c9543ee60d4e3cb9dfcd8e50615b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c264f213-9131-426f-a3d6-7f6feef554a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c264f213-9131-426f-a3d6-7f6feef554a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4145521c-151f-4033-aa67-a688ed2bcbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4145521c-151f-4033-aa67-a688ed2bcbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e3fe179-7d87-41ef-a5de-a5ca32371558', 'volume_name': 'volume-8e3fe179-7d87-41ef-a5de-a5ca32371558', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d39526-b3a3-45d2-8d1b-0696ab71f040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d39526-b3a3-45d2-8d1b-0696ab71f040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0efa5e-70b4-4c01-bb0f-00bde15a10ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:38 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Volume 8e3fe179-7d87-41ef-a5de-a5ca32371558: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e3fe179-7d87-41ef-a5de-a5ca32371558', 'volume_size': 1} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1120541152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3fe179-7d87-41ef-a5de-a5ca32371558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d01fae3509844e499bcef4cc311d4b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:45:38Z,use_quota=True,user_id='73c9543ee60d4e3cb9dfcd8e50615b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Creating volume 8e3fe179-7d87-41ef-a5de-a5ca32371558 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:45:38 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:45:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:38 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 1073741824 Sep 23 12:45:38 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:39 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 1073741824" returned: 0 in 0.766s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:39 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 Sep 23 12:45:39 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Flow 'volume_create_manager' (0fb608f2-d5d0-45e6-90c3-bd39f162e2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:45:39 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492b61db-3eee-4bdf-949c-78930f097377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558" returned: 0 in 0.438s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0efa5e-70b4-4c01-bb0f-00bde15a10ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e3fe179-7d87-41ef-a5de-a5ca32371558', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa4558d-97e0-46e8-af2e-8b78b587a363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492b61db-3eee-4bdf-949c-78930f097377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1663453700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c0bea2-5547-4edc-882d-dd2d42ce5b65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f0b6e3cc164f6a8f72dfc78a5aefca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:45:39Z,use_quota=True,user_id='6e400c820bae47b8a8a0d0eab735973e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c01688-bb30-4136-b526-be4c068c661f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c01688-bb30-4136-b526-be4c068c661f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f453f5-0ca2-434c-889b-e0eaa23edba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f453f5-0ca2-434c-889b-e0eaa23edba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '99c0bea2-5547-4edc-882d-dd2d42ce5b65', 'volume_name': 'volume-99c0bea2-5547-4edc-882d-dd2d42ce5b65', 'volume_size': 1, 'snapshot_id': 'd8c58ef7-5eb6-49a1-b3d2-27e92cbde4af'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d73aee-25ff-4f43-9b29-12cf58dd0656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d73aee-25ff-4f43-9b29-12cf58dd0656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c17184e-3bf5-43e3-ac6d-78a255bf3529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:39 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Volume 99c0bea2-5547-4edc-882d-dd2d42ce5b65: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-99c0bea2-5547-4edc-882d-dd2d42ce5b65', 'volume_size': 1, 'snapshot_id': 'd8c58ef7-5eb6-49a1-b3d2-27e92cbde4af'} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-quobyte-d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af-99c0bea2-5547-4edc-882d-dd2d42ce5b65" by "_create_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:39 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Volume volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 (8e3fe179-7d87-41ef-a5de-a5ca32371558): created successfully Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa4558d-97e0-46e8-af2e-8b78b587a363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Flow 'volume_create_manager' (327dc4b8-fa16-4e7f-8743-70de0134f31d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Flow 'volume_create_manager' (2ce1d6e5-6672-496e-8048-c108b26eecb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344fbdf7-ce40-4f53-b8d1-10fe54d85156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af-99c0bea2-5547-4edc-882d-dd2d42ce5b65" acquired by "_create_volume_from_snapshot" :: waited 0.088s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Creating volume 99c0bea2-5547-4edc-882d-dd2d42ce5b65 from snapshot d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af {{(pid=86085) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-quobyte-99c0bea2-5547-4edc-882d-dd2d42ce5b65" by "_copy_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:39 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-5c3213bc-1597-4a06-a12f-2e57f381cad4 tempest-TestStampPattern-1792644428 None] Created volume successfully. Sep 23 12:45:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344fbdf7-ce40-4f53-b8d1-10fe54d85156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-791539532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90efa8bf-d02a-4ed2-ae20-29518a5535a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3507f36903b040deb7cdec05078b6f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:45:40Z,use_quota=True,user_id='0ca24fef50164808b37d8d0a4ea14b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbcb2809-225a-4117-90af-8ed6382d54a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbcb2809-225a-4117-90af-8ed6382d54a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b85e3f6-9215-426b-99de-eea033948c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b85e3f6-9215-426b-99de-eea033948c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90efa8bf-d02a-4ed2-ae20-29518a5535a0', 'volume_name': 'volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1b347b-a707-4358-8493-4b929d8f6870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1b347b-a707-4358-8493-4b929d8f6870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97852de8-8915-46c8-ada2-d904d70fb5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:40 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Volume 90efa8bf-d02a-4ed2-ae20-29518a5535a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0', 'volume_size': 1} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-99c0bea2-5547-4edc-882d-dd2d42ce5b65" acquired by "_copy_volume_from_snapshot" :: waited 0.152s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] snapshot: d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af, volume: 99c0bea2-5547-4edc-882d-dd2d42ce5b65, {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb5ed7f-eaf9-4dc8-a7c4-912174214e22]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:40 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af Sep 23 12:45:40 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Flow 'volume_create_manager' (631dd7f8-23df-45ff-9959-0e29b0b2ca65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (469ba0de-9d74-48d9-9afe-fc3a9b0be52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (469ba0de-9d74-48d9-9afe-fc3a9b0be52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-795795499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e25941f-055e-414c-8e69-c5e261a86f09,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13cb076ef1d64ab883624acc40ffadef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:45:40Z,use_quota=True,user_id='dfbc39d4756e4724815222969a4feb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be27cc3b-3e0b-4a98-a7a3-ef148566c8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be27cc3b-3e0b-4a98-a7a3-ef148566c8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22431d1-b6a8-4328-b7a0-57c229500c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22431d1-b6a8-4328-b7a0-57c229500c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e25941f-055e-414c-8e69-c5e261a86f09', 'volume_name': 'volume-9e25941f-055e-414c-8e69-c5e261a86f09', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f071cb29-a664-43b5-8e6f-99c85a7db6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f071cb29-a664-43b5-8e6f-99c85a7db6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa05b9cb-d779-44cc-91b9-cb5522a890e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:40 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Volume 9e25941f-055e-414c-8e69-c5e261a86f09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e25941f-055e-414c-8e69-c5e261a86f09', 'volume_size': 1} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:40 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af" returned: 0 in 0.461s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f307e4c-a4db-4509-87d1-2037800b4042(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dba2a0-587e-48e1-98ff-b9443d5c0d4f]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:40 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042 Sep 23 12:45:40 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:41 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042" returned: 0 in 0.395s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] will copy from snapshot at /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042 {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 12:45:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Creating direct copy from snapshot {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 12:45:41 devstack cinder-volume[86085]: DEBUG cinder.utils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Path /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99c0bea2-5547-4edc-882d-dd2d42ce5b65 not found in is_blk_device check {{(pid=86085) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 12:45:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99c0bea2-5547-4edc-882d-dd2d42ce5b65 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:41 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99c0bea2-5547-4edc-882d-dd2d42ce5b65 Sep 23 12:45:41 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:45:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:45:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:45:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:41 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:45:41 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:41 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.369s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:41 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:45:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:45:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:45:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:45:49 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99c0bea2-5547-4edc-882d-dd2d42ce5b65" returned: 0 in 8.486s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:49 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Image conversion details: src /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042, size 1024.00 MB, duration 8.49 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99c0bea2-5547-4edc-882d-dd2d42ce5b65 {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:45:49 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Converted 1024.00 MB image at 120.65 MB/s Sep 23 12:45:49 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99c0bea2-5547-4edc-882d-dd2d42ce5b65 is being set with open permissions: ugo+rw Sep 23 12:45:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99c0bea2-5547-4edc-882d-dd2d42ce5b65 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:49 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99c0bea2-5547-4edc-882d-dd2d42ce5b65 Sep 23 12:45:49 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:49 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99c0bea2-5547-4edc-882d-dd2d42ce5b65" returned: 0 in 0.386s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:49 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-99c0bea2-5547-4edc-882d-dd2d42ce5b65" released by "_copy_volume_from_snapshot" :: held 9.870s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af-99c0bea2-5547-4edc-882d-dd2d42ce5b65" released by "_create_volume_from_snapshot" :: held 10.094s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.184s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.943s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-791539532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90efa8bf-d02a-4ed2-ae20-29518a5535a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3507f36903b040deb7cdec05078b6f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:45:40Z,use_quota=True,user_id='0ca24fef50164808b37d8d0a4ea14b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Creating volume 90efa8bf-d02a-4ed2-ae20-29518a5535a0 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:45:50 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:50 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0 1073741824 Sep 23 12:45:50 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c17184e-3bf5-43e3-ac6d-78a255bf3529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99c0bea2-5547-4edc-882d-dd2d42ce5b65', 'volume_size': 1, 'snapshot_id': 'd8c58ef7-5eb6-49a1-b3d2-27e92cbde4af'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88859a27-34c7-419a-b392-37a333162d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:50 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Volume volume-99c0bea2-5547-4edc-882d-dd2d42ce5b65 (99c0bea2-5547-4edc-882d-dd2d42ce5b65): created successfully Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88859a27-34c7-419a-b392-37a333162d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Flow 'volume_create_manager' (0fb608f2-d5d0-45e6-90c3-bd39f162e2fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:45:50 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f135b959-0d3b-4abc-b850-65bd176d1dff tempest-VolumesSnapshotTestJSON-1315847500 None] Created volume successfully. Sep 23 12:45:50 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0 1073741824" returned: 0 in 0.482s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:50 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0 Sep 23 12:45:50 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-99c0bea2-5547-4edc-882d-dd2d42ce5b65-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:50 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-99c0bea2-5547-4edc-882d-dd2d42ce5b65-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0" returned: 0 in 0.278s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.323s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-795795499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e25941f-055e-414c-8e69-c5e261a86f09,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13cb076ef1d64ab883624acc40ffadef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:45:40Z,use_quota=True,user_id='dfbc39d4756e4724815222969a4feb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Creating volume 9e25941f-055e-414c-8e69-c5e261a86f09 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:45:50 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e25941f-055e-414c-8e69-c5e261a86f09 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:50 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e25941f-055e-414c-8e69-c5e261a86f09 1073741824 Sep 23 12:45:50 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97852de8-8915-46c8-ada2-d904d70fb5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b12da90-5f7d-4470-b821-e85bdc24f76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:50 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Volume volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0 (90efa8bf-d02a-4ed2-ae20-29518a5535a0): created successfully Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b12da90-5f7d-4470-b821-e85bdc24f76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Flow 'volume_create_manager' (2ce1d6e5-6672-496e-8048-c108b26eecb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:45:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-quobyte-99c0bea2-5547-4edc-882d-dd2d42ce5b65" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:51 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-58ca70bd-8109-4e19-9d3b-6c71eeb5eec1 tempest-TestImageHashVerification-64019634 None] Created volume successfully. Sep 23 12:45:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-99c0bea2-5547-4edc-882d-dd2d42ce5b65" acquired by "delete_volume" :: waited 0.041s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:51 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28a23ce-6fb8-4501-949b-fba3fb802621]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99c0bea2-5547-4edc-882d-dd2d42ce5b65 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:51 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99c0bea2-5547-4edc-882d-dd2d42ce5b65 Sep 23 12:45:51 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:51 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e25941f-055e-414c-8e69-c5e261a86f09 1073741824" returned: 0 in 0.674s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e25941f-055e-414c-8e69-c5e261a86f09 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:51 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e25941f-055e-414c-8e69-c5e261a86f09 Sep 23 12:45:51 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:51 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99c0bea2-5547-4edc-882d-dd2d42ce5b65" returned: 0 in 0.523s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99c0bea2-5547-4edc-882d-dd2d42ce5b65 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:51 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99c0bea2-5547-4edc-882d-dd2d42ce5b65 Sep 23 12:45:51 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:51 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e25941f-055e-414c-8e69-c5e261a86f09" returned: 0 in 0.310s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:45:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa05b9cb-d779-44cc-91b9-cb5522a890e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e25941f-055e-414c-8e69-c5e261a86f09', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab14783b-edec-4380-b184-0893c3281a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:45:52 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Volume volume-9e25941f-055e-414c-8e69-c5e261a86f09 (9e25941f-055e-414c-8e69-c5e261a86f09): created successfully Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab14783b-edec-4380-b184-0893c3281a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Flow 'volume_create_manager' (631dd7f8-23df-45ff-9959-0e29b0b2ca65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:45:52 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99c0bea2-5547-4edc-882d-dd2d42ce5b65" returned: 0 in 0.467s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:52 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-f1119eea-8570-4305-ac78-96ce7979e459 req-b2011d15-72f4-40d5-814a-c9d2a6cd7964 tempest-VolumesGetTestJSON-1171694972 None] Created volume successfully. Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-99c0bea2-5547-4edc-882d-dd2d42ce5b65" released by "delete_volume" :: held 1.081s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] Created reservations ['0a5a954f-4efe-49e7-8b84-7ef6b4f48848', 'e738c106-2292-48b0-9e06-9e0555adf318', 'e738f5cf-370a-4474-991e-a322e125153e', 'fa56476b-9bb2-4437-8700-d71e342f4d4e'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] Acquiring lock "cinder-9e25941f-055e-414c-8e69-c5e261a86f09-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:52 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:45:52 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] Lock "cinder-9e25941f-055e-414c-8e69-c5e261a86f09-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] Acquiring lock "cinder-quobyte-9e25941f-055e-414c-8e69-c5e261a86f09" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] Lock "cinder-quobyte-9e25941f-055e-414c-8e69-c5e261a86f09" acquired by "delete_volume" :: waited 0.046s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbaa613-2df8-46e1-b242-13949ddf7500]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e25941f-055e-414c-8e69-c5e261a86f09 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:52 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.325s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:45:52 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] Deleted volume successfully. Sep 23 12:45:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-351d4f31-c147-4818-922b-4d6fe2f7832d tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-99c0bea2-5547-4edc-882d-dd2d42ce5b65-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:52 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e25941f-055e-414c-8e69-c5e261a86f09 Sep 23 12:45:52 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:53 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-quobyte-5f307e4c-a4db-4509-87d1-2037800b4042" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e25941f-055e-414c-8e69-c5e261a86f09" returned: 0 in 0.587s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e25941f-055e-414c-8e69-c5e261a86f09 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-5f307e4c-a4db-4509-87d1-2037800b4042" acquired by "delete_snapshot" :: waited 0.064s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-quobyte-d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:53 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e25941f-055e-414c-8e69-c5e261a86f09 Sep 23 12:45:53 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] Deleting offline snapshot d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af of volume 5f307e4c-a4db-4509-87d1-2037800b4042 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:45:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] snapshot_file for this snap is: volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:45:53 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d3c685-5a0f-45cf-9e36-b8e62e0a837b]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-14ecb935-432b-4c0f-8305-2c19e0fc1bc5 tempest-TestImageHashVerification-64019634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-14ecb935-432b-4c0f-8305-2c19e0fc1bc5 tempest-TestImageHashVerification-64019634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:53 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[da981641-3031-470a-8459-e047c6cdde25]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-14ecb935-432b-4c0f-8305-2c19e0fc1bc5 tempest-TestImageHashVerification-64019634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:53 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af Sep 23 12:45:53 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:53 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9e25941f-055e-414c-8e69-c5e261a86f09" returned: 0 in 0.461s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] Lock "cinder-quobyte-9e25941f-055e-414c-8e69-c5e261a86f09" released by "delete_volume" :: held 1.137s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:53 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0 Sep 23 12:45:53 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:53 devstack cinder-volume[86085]: DEBUG cinder.quota [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] Created reservations ['350cedd0-8444-4b64-82f0-6ecb80a4c87f', '58865842-4a06-4bff-8780-e6801ca0bdf6', '5a9934e0-06aa-4e80-9459-21c4a74d6e17', '3f383e3e-daa9-4d0b-897f-5f02b4c7201e'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:45:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:45:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:45:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:45:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:45:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:45:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:54 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:45:54 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:54 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af" returned: 0 in 0.698s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f307e4c-a4db-4509-87d1-2037800b4042(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:45:54 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b91c1d7-5d7e-4172-88b7-3f556678f2d4]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:54 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-14ecb935-432b-4c0f-8305-2c19e0fc1bc5 tempest-TestImageHashVerification-64019634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0" returned: 0 in 0.766s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:54 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b4ddff-70f4-4246-bef4-3fc2e652cbe2]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-14ecb935-432b-4c0f-8305-2c19e0fc1bc5 tempest-TestImageHashVerification-64019634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:54 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042 Sep 23 12:45:54 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:54 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.390s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:54 devstack cinder-volume[86085]: DEBUG cinder.manager [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:45:54 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] Deleted volume successfully. Sep 23 12:45:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-1d6f1e49-1380-4259-b908-2e976b619cc0 req-30db4d25-8746-4985-b3df-f82bff46a9cb tempest-VolumesGetTestJSON-1171694972 None] Lock "cinder-9e25941f-055e-414c-8e69-c5e261a86f09-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:54 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0 Sep 23 12:45:54 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:54 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-14ecb935-432b-4c0f-8305-2c19e0fc1bc5 tempest-TestImageHashVerification-64019634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0" returned: 0 in 0.553s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-14ecb935-432b-4c0f-8305-2c19e0fc1bc5 tempest-TestImageHashVerification-64019634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0 /opt/stack/data/cinder/conversion/90efa8bf-d02a-4ed2-ae20-29518a5535a0.temp_image.ae765213-2966-4788-b9e7-114d09c0676akdd0hsoj.img {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:55 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0 /opt/stack/data/cinder/conversion/90efa8bf-d02a-4ed2-ae20-29518a5535a0.temp_image.ae765213-2966-4788-b9e7-114d09c0676akdd0hsoj.img Sep 23 12:45:55 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:55 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042" returned: 0 in 1.118s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:55 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af Sep 23 12:45:55 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:56 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af" returned: 0 in 1.597s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:57 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af Sep 23 12:45:57 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:45:57 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Sep 23 12:45:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042.d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af" returned: 0 in 0.860s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:45:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af" released by "_delete_snapshot" :: held 4.536s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-5f307e4c-a4db-4509-87d1-2037800b4042" released by "delete_snapshot" :: held 4.602s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:58 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] Created reservations ['a696993b-c839-48aa-a7ce-9048cfb0f7e6', '170845de-0388-40c8-b849-2a12b15605cf', '3d5aaa70-09da-4120-ae4b-77a56a20bed2', 'b6ce43a3-8d9c-4de0-bf49-b322cd0ed8d6'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:45:58 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] Delete snapshot completed successfully. Sep 23 12:45:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5e77f617-b68c-475e-80a4-48be77e866ff tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-d8c58ef7-5eb6-49a1-b3d2-27e92cbde4af-delete_snapshot" released by "delete_snapshot" :: held 5.029s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:45:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-5f307e4c-a4db-4509-87d1-2037800b4042-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-5f307e4c-a4db-4509-87d1-2037800b4042-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-quobyte-5f307e4c-a4db-4509-87d1-2037800b4042" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:45:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-5f307e4c-a4db-4509-87d1-2037800b4042" acquired by "delete_volume" :: waited 0.031s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:45:59 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd716c5-a48a-493e-9a6e-76882672fbed]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:45:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:45:59 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042 Sep 23 12:45:59 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:00 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042" returned: 0 in 0.682s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:00 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042 Sep 23 12:46:00 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:00 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f307e4c-a4db-4509-87d1-2037800b4042" returned: 0 in 0.425s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-5f307e4c-a4db-4509-87d1-2037800b4042" released by "delete_volume" :: held 1.294s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:46:00 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] Created reservations ['f4cdeeea-31f6-4c78-8785-07f812c618e0', '1d6b1958-1fc2-496e-b5de-cfa40d4d12a7', '87d27f5e-664f-40ce-979e-7cd6a72ada05', 'e9d1cdd2-4947-428a-a13c-99c04debe9dd'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:46:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:46:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:46:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:46:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:46:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:46:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:01 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:46:01 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:01 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.724s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:01 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:46:01 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] Deleted volume successfully. Sep 23 12:46:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-5690b34a-255a-4ae6-94ad-722e32b735bc-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:46:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3d8f6e00-9591-4fe0-9ea0-002de7325a9a tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-5f307e4c-a4db-4509-87d1-2037800b4042-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:46:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-5690b34a-255a-4ae6-94ad-722e32b735bc-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:46:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "cinder-quobyte-5690b34a-255a-4ae6-94ad-722e32b735bc" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:46:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-5690b34a-255a-4ae6-94ad-722e32b735bc" acquired by "delete_volume" :: waited 0.026s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:46:02 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b770679c-90e9-4e7e-9459-c41a15fd3f86]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:46:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:02 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc Sep 23 12:46:02 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:02 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc" returned: 0 in 0.891s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:02 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc Sep 23 12:46:02 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:03 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5690b34a-255a-4ae6-94ad-722e32b735bc" returned: 0 in 0.577s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-quobyte-5690b34a-255a-4ae6-94ad-722e32b735bc" released by "delete_volume" :: held 1.612s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:46:03 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] Created reservations ['c344abe5-3a70-46fa-9fb5-97d5ea028d73', '2557f151-8079-49f8-9d8c-9b2a0e727212', 'b581da02-4bd3-4925-98df-58c806c30234', '7c276e11-cea8-4ef8-aa84-286c61296e89'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:46:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:46:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:46:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:46:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:46:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:46:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:04 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:46:04 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:04 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.446s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:04 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:46:04 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] Deleted volume successfully. Sep 23 12:46:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d59e682e-cee9-4182-87d1-8ae255bbfc77 tempest-VolumesSnapshotTestJSON-1315847500 None] Lock "cinder-5690b34a-255a-4ae6-94ad-722e32b735bc-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:46:04 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-14ecb935-432b-4c0f-8305-2c19e0fc1bc5 tempest-TestImageHashVerification-64019634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0 /opt/stack/data/cinder/conversion/90efa8bf-d02a-4ed2-ae20-29518a5535a0.temp_image.ae765213-2966-4788-b9e7-114d09c0676akdd0hsoj.img" returned: 0 in 9.635s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:04 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c018d865-bf2e-40b7-859f-d1e375d6a0a8]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:46:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-14ecb935-432b-4c0f-8305-2c19e0fc1bc5 tempest-TestImageHashVerification-64019634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:04 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0 Sep 23 12:46:04 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:05 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-14ecb935-432b-4c0f-8305-2c19e0fc1bc5 tempest-TestImageHashVerification-64019634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0" returned: 0 in 0.583s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:05 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-14ecb935-432b-4c0f-8305-2c19e0fc1bc5 tempest-TestImageHashVerification-64019634 None] Image conversion details: src /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0, size 1024.00 MB, duration 9.64 sec, destination /opt/stack/data/cinder/conversion/90efa8bf-d02a-4ed2-ae20-29518a5535a0.temp_image.ae765213-2966-4788-b9e7-114d09c0676akdd0hsoj.img {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:46:05 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-14ecb935-432b-4c0f-8305-2c19e0fc1bc5 tempest-TestImageHashVerification-64019634 None] Converted 1024.00 MB image at 106.27 MB/s Sep 23 12:46:05 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-14ecb935-432b-4c0f-8305-2c19e0fc1bc5 tempest-TestImageHashVerification-64019634 None] ae765213-2966-4788-b9e7-114d09c0676a was raw, no need to convert to raw {{(pid=86085) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 23 12:46:13 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=76,cinder:INSERT=25,cinder:UPDATE=98,cinder:DELETE=8 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:46:15 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=71,cinder:INSERT=26,cinder:UPDATE=105,cinder:DELETE=8 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:46:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-d6a8a1f0-56bb-406c-8ece-7d876f416d81 req-3432a8f4-68a2-482c-912f-6845e273090d tempest-TestStampPattern-1792644428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:46:19 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-809ab3ba-693a-4a3a-85ab-e87fefe40ea5 tempest-GroupsV320Test-1488968137 None] Group tempest-GroupsV320Test-Group-1818112995: creating Sep 23 12:46:20 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-809ab3ba-693a-4a3a-85ab-e87fefe40ea5 tempest-GroupsV320Test-1488968137 None] Group tempest-GroupsV320Test-Group-1818112995: created successfully Sep 23 12:46:20 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-809ab3ba-693a-4a3a-85ab-e87fefe40ea5 tempest-GroupsV320Test-1488968137 None] Create group completed successfully. Sep 23 12:46:21 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-856487d2-b54a-444e-9b10-f6974d0f1d4f tempest-GroupsV320Test-1488968137 None] Created reservations ['09159171-cd00-42bb-9932-b874924c0c98'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:46:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-856487d2-b54a-444e-9b10-f6974d0f1d4f tempest-GroupsV320Test-1488968137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:46:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-856487d2-b54a-444e-9b10-f6974d0f1d4f tempest-GroupsV320Test-1488968137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:46:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-856487d2-b54a-444e-9b10-f6974d0f1d4f tempest-GroupsV320Test-1488968137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:46:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-856487d2-b54a-444e-9b10-f6974d0f1d4f tempest-GroupsV320Test-1488968137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:46:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-856487d2-b54a-444e-9b10-f6974d0f1d4f tempest-GroupsV320Test-1488968137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:46:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-856487d2-b54a-444e-9b10-f6974d0f1d4f tempest-GroupsV320Test-1488968137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:21 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:46:21 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:22 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-856487d2-b54a-444e-9b10-f6974d0f1d4f tempest-GroupsV320Test-1488968137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.333s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:22 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-856487d2-b54a-444e-9b10-f6974d0f1d4f tempest-GroupsV320Test-1488968137 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:46:22 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-856487d2-b54a-444e-9b10-f6974d0f1d4f tempest-GroupsV320Test-1488968137 None] Delete group completed successfully. Sep 23 12:46:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-14ecb935-432b-4c0f-8305-2c19e0fc1bc5 tempest-TestImageHashVerification-64019634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.482s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:46:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-14ecb935-432b-4c0f-8305-2c19e0fc1bc5 tempest-TestImageHashVerification-64019634 None] Uploaded volume to glance image-id: ae765213-2966-4788-b9e7-114d09c0676a. {{(pid=86085) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 12:46:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-d6a8a1f0-56bb-406c-8ece-7d876f416d81 req-3432a8f4-68a2-482c-912f-6845e273090d tempest-TestStampPattern-1792644428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.599s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:46:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-d6a8a1f0-56bb-406c-8ece-7d876f416d81 req-3432a8f4-68a2-482c-912f-6845e273090d tempest-TestStampPattern-1792644428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:46:31 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-14ecb935-432b-4c0f-8305-2c19e0fc1bc5 tempest-TestImageHashVerification-64019634 None] Copy volume to image completed successfully. Sep 23 12:46:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-d6a8a1f0-56bb-406c-8ece-7d876f416d81 req-3432a8f4-68a2-482c-912f-6845e273090d tempest-TestStampPattern-1792644428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-8e3fe179-7d87-41ef-a5de-a5ca32371558', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '806db434-8476-4069-a432-0a411477f168', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:46:31 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-d6a8a1f0-56bb-406c-8ece-7d876f416d81 req-3432a8f4-68a2-482c-912f-6845e273090d tempest-TestStampPattern-1792644428 None] attachment_update completed successfully. Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Flow 'volume_create_manager' (9944577a-705b-494f-9a0e-633b614caea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea5d117-2332-4f2b-a8cb-9b242f6eceaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea5d117-2332-4f2b-a8cb-9b242f6eceaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1338559799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce439bd-08ae-4b70-be9a-3ffb74f57d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77958113ff94058a50bcfdcef5bd7c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:46:32Z,use_quota=True,user_id='65ee4f620aff426dbbc7a40bd8cfdff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc88e8b8-d64c-4c6a-b67f-6c2625547a5b),volume_type_id=fc88e8b8-d64c-4c6a-b67f-6c2625547a5b)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb77033-cc83-4e82-b93c-f2d71cbeab2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb77033-cc83-4e82-b93c-f2d71cbeab2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378eea49-7f7c-4b6e-8d3c-742aa720cf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378eea49-7f7c-4b6e-8d3c-742aa720cf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cce439bd-08ae-4b70-be9a-3ffb74f57d63', 'volume_name': 'volume-cce439bd-08ae-4b70-be9a-3ffb74f57d63', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b981d7c-e644-457b-babe-ac86f6dbc17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b981d7c-e644-457b-babe-ac86f6dbc17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52c9af2-b867-4ea7-9a9e-484fdc07311c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:32 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Volume cce439bd-08ae-4b70-be9a-3ffb74f57d63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cce439bd-08ae-4b70-be9a-3ffb74f57d63', 'volume_size': 1} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1338559799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce439bd-08ae-4b70-be9a-3ffb74f57d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77958113ff94058a50bcfdcef5bd7c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:46:32Z,use_quota=True,user_id='65ee4f620aff426dbbc7a40bd8cfdff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc88e8b8-d64c-4c6a-b67f-6c2625547a5b),volume_type_id=fc88e8b8-d64c-4c6a-b67f-6c2625547a5b)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Creating volume cce439bd-08ae-4b70-be9a-3ffb74f57d63 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:46:32 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cce439bd-08ae-4b70-be9a-3ffb74f57d63 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] Acquiring lock "cinder-90efa8bf-d02a-4ed2-ae20-29518a5535a0-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:46:32 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cce439bd-08ae-4b70-be9a-3ffb74f57d63 1073741824 Sep 23 12:46:32 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] Lock "cinder-90efa8bf-d02a-4ed2-ae20-29518a5535a0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] Acquiring lock "cinder-quobyte-90efa8bf-d02a-4ed2-ae20-29518a5535a0" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] Lock "cinder-quobyte-90efa8bf-d02a-4ed2-ae20-29518a5535a0" acquired by "delete_volume" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c44966d-0cf7-4a57-809a-84302a4a33ff]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:46:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:32 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0 Sep 23 12:46:32 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:33 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cce439bd-08ae-4b70-be9a-3ffb74f57d63 1073741824" returned: 0 in 0.630s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:33 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0" returned: 0 in 0.489s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cce439bd-08ae-4b70-be9a-3ffb74f57d63 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:33 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0 Sep 23 12:46:33 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:33 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cce439bd-08ae-4b70-be9a-3ffb74f57d63 Sep 23 12:46:33 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:33 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-90efa8bf-d02a-4ed2-ae20-29518a5535a0" returned: 0 in 0.316s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] Lock "cinder-quobyte-90efa8bf-d02a-4ed2-ae20-29518a5535a0" released by "delete_volume" :: held 0.877s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:46:33 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cce439bd-08ae-4b70-be9a-3ffb74f57d63" returned: 0 in 0.341s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52c9af2-b867-4ea7-9a9e-484fdc07311c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cce439bd-08ae-4b70-be9a-3ffb74f57d63', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f2dd77-17a1-4b3e-8e10-3cd8e81be4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:33 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Volume volume-cce439bd-08ae-4b70-be9a-3ffb74f57d63 (cce439bd-08ae-4b70-be9a-3ffb74f57d63): created successfully Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f2dd77-17a1-4b3e-8e10-3cd8e81be4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Flow 'volume_create_manager' (9944577a-705b-494f-9a0e-633b614caea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:46:33 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-565ca403-499a-41f1-98bc-b908646d74f5 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Created volume successfully. Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] Created reservations ['404647ee-7ee2-4bd8-8477-d7416090f856', '73bc1ef1-444c-4ccd-ba92-6ee2bf5f4bb9', 'e3d996e9-fd91-4dff-8afc-35dbf2cc7fb0', 'efb29d94-d66d-40ce-ad81-95db537b7392'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:46:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:33 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:46:33 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:34 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.474s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:34 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:46:34 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] Deleted volume successfully. Sep 23 12:46:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f373dc26-f715-45d7-9206-2d80e89071b0 tempest-TestImageHashVerification-64019634 None] Lock "cinder-90efa8bf-d02a-4ed2-ae20-29518a5535a0-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:46:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d9a5b1af-a443-4420-9279-c89f0bb77930 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:46:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d9a5b1af-a443-4420-9279-c89f0bb77930 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:46:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d9a5b1af-a443-4420-9279-c89f0bb77930 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:46:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d9a5b1af-a443-4420-9279-c89f0bb77930 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:46:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d9a5b1af-a443-4420-9279-c89f0bb77930 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:46:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d9a5b1af-a443-4420-9279-c89f0bb77930 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:35 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:46:35 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:35 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d9a5b1af-a443-4420-9279-c89f0bb77930 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.317s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:35 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-d9a5b1af-a443-4420-9279-c89f0bb77930 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:46:35 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d9a5b1af-a443-4420-9279-c89f0bb77930 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Retype volume completed successfully. Sep 23 12:46:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Acquiring lock "cinder-cce439bd-08ae-4b70-be9a-3ffb74f57d63-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:46:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Lock "cinder-cce439bd-08ae-4b70-be9a-3ffb74f57d63-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:46:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Acquiring lock "cinder-quobyte-cce439bd-08ae-4b70-be9a-3ffb74f57d63" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:46:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Lock "cinder-quobyte-cce439bd-08ae-4b70-be9a-3ffb74f57d63" acquired by "delete_volume" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:46:36 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[da84f018-302a-4b7f-8c9e-c44fde8ef13b]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:46:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cce439bd-08ae-4b70-be9a-3ffb74f57d63 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:36 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cce439bd-08ae-4b70-be9a-3ffb74f57d63 Sep 23 12:46:36 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:37 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cce439bd-08ae-4b70-be9a-3ffb74f57d63" returned: 0 in 0.673s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cce439bd-08ae-4b70-be9a-3ffb74f57d63 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:37 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cce439bd-08ae-4b70-be9a-3ffb74f57d63 Sep 23 12:46:37 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:37 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-808adfe7-4daa-43d3-b31c-de6144fa9f1f req-78f03eeb-b21f-4908-8da4-68d50c109692 tempest-TestStampPattern-1792644428 None] Terminate volume connection completed successfully. Sep 23 12:46:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-808adfe7-4daa-43d3-b31c-de6144fa9f1f req-78f03eeb-b21f-4908-8da4-68d50c109692 tempest-TestStampPattern-1792644428 None] Deleting attachment 806db434-8476-4069-a432-0a411477f168. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:46:37 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-cce439bd-08ae-4b70-be9a-3ffb74f57d63" returned: 0 in 0.545s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Lock "cinder-quobyte-cce439bd-08ae-4b70-be9a-3ffb74f57d63" released by "delete_volume" :: held 1.310s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:46:38 devstack cinder-volume[86085]: WARNING cinder.quota [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:46:38 devstack cinder-volume[86085]: WARNING cinder.quota [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:46:38 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Created reservations ['6c963c82-9690-4786-902f-5880c25f4985', 'f3df5b66-2282-4738-b9ce-13d098029b8d', '1411ae1a-4914-4b1b-ae32-3429cefb2f2a', '50e7e389-64d6-469d-bacb-7ab733de5c4d'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:46:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:46:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:46:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:46:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:46:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:46:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:38 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:46:38 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:38 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.350s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:38 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:46:38 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Deleted volume successfully. Sep 23 12:46:38 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d6b96968-d7b5-459e-b113-9b12cfd97be6 tempest-VolumeRetypeWithoutMigrationTest-549504009 None] Lock "cinder-cce439bd-08ae-4b70-be9a-3ffb74f57d63-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:46:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a65a3a78-94cf-4e1c-bca3-092c005754d2 tempest-TestStampPattern-1792644428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:46:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a65a3a78-94cf-4e1c-bca3-092c005754d2 tempest-TestStampPattern-1792644428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:46:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-a65a3a78-94cf-4e1c-bca3-092c005754d2 tempest-TestStampPattern-1792644428 None] Creating offline snapshot fc98c089-ddc4-4fdc-bdde-09605fabe865 of volume 8e3fe179-7d87-41ef-a5de-a5ca32371558 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:46:38 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e650a3d4-895a-489f-8940-eefca754e7ae]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:46:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a65a3a78-94cf-4e1c-bca3-092c005754d2 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:38 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 Sep 23 12:46:38 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:39 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a65a3a78-94cf-4e1c-bca3-092c005754d2 tempest-TestStampPattern-1792644428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558" returned: 0 in 0.442s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a65a3a78-94cf-4e1c-bca3-092c005754d2 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:39 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865 1G Sep 23 12:46:39 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:39 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a65a3a78-94cf-4e1c-bca3-092c005754d2 tempest-TestStampPattern-1792644428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865 1G" returned: 0 in 0.585s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a65a3a78-94cf-4e1c-bca3-092c005754d2 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:39 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865 Sep 23 12:46:39 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:40 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a65a3a78-94cf-4e1c-bca3-092c005754d2 tempest-TestStampPattern-1792644428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865" returned: 0 in 0.409s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:40 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-a65a3a78-94cf-4e1c-bca3-092c005754d2 tempest-TestStampPattern-1792644428 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865 is being set with open permissions: ugo+rw Sep 23 12:46:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a65a3a78-94cf-4e1c-bca3-092c005754d2 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:40 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865 Sep 23 12:46:40 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:40 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a65a3a78-94cf-4e1c-bca3-092c005754d2 tempest-TestStampPattern-1792644428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865" returned: 0 in 0.312s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a65a3a78-94cf-4e1c-bca3-092c005754d2 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:40 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.info Sep 23 12:46:40 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:40 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a65a3a78-94cf-4e1c-bca3-092c005754d2 tempest-TestStampPattern-1792644428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.info" returned: 0 in 0.350s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:40 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-a65a3a78-94cf-4e1c-bca3-092c005754d2 tempest-TestStampPattern-1792644428 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.info is being set with open permissions: ugo+rw Sep 23 12:46:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a65a3a78-94cf-4e1c-bca3-092c005754d2 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:40 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.info Sep 23 12:46:40 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:41 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a65a3a78-94cf-4e1c-bca3-092c005754d2 tempest-TestStampPattern-1792644428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.info" returned: 0 in 0.281s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a65a3a78-94cf-4e1c-bca3-092c005754d2 tempest-TestStampPattern-1792644428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.492s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:46:41 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-a65a3a78-94cf-4e1c-bca3-092c005754d2 tempest-TestStampPattern-1792644428 None] Create snapshot completed successfully Sep 23 12:46:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:46:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:46:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:46:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:46:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:46:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:46:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:41 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:46:41 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:41 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.293s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:41 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:46:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:46:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:46:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:46:49 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:46:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Flow 'volume_create_manager' (2c2b08a2-397f-4ee5-a180-9c3f6b61f239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:46:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4636a309-29a6-4fef-b4b8-5ae5cb0a7bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4636a309-29a6-4fef-b4b8-5ae5cb0a7bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-50980562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe155ffd-3136-465a-9d87-8500fe1d8f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831edd3b4bc743668db11f403e5a4431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:46:49Z,use_quota=True,user_id='cc72f608405d4b1894f5e0097d9d4c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:46:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a53812-4eff-4231-bb0a-1cd5575c1872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a53812-4eff-4231-bb0a-1cd5575c1872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:46:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb915cd4-0533-4f13-a633-0e94965714c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:49 devstack cinder-volume[86085]: DEBUG cinder.image.glance [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Creating Keystone auth plugin from conf {{(pid=86085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 12:46:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb915cd4-0533-4f13-a633-0e94965714c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fe155ffd-3136-465a-9d87-8500fe1d8f7e', 'volume_name': 'volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e', 'volume_size': 1, 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3c5121b794a4715babb77a8b7da12a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'created_at': datetime.datetime(2026, 9, 23, 10, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 27, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:46:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab473b9-cc48-48d3-9832-995b4d519355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab473b9-cc48-48d3-9832-995b4d519355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:46:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd4c1b6-a672-46e4-843e-3eb410d8a1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:49 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Volume fe155ffd-3136-465a-9d87-8500fe1d8f7e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e', 'volume_size': 1, 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3c5121b794a4715babb77a8b7da12a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'created_at': datetime.datetime(2026, 9, 23, 10, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 27, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 12:46:49 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Trying to clone fe155ffd-3136-465a-9d87-8500fe1d8f7e from image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]). {{(pid=86085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Flow 'volume_create_manager' (077b61e5-df44-423f-8d76-170bbaaae4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6dbee52-475a-4705-a882-f3663937af6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6dbee52-475a-4705-a882-f3663937af6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-963681245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5892c2f-017c-455b-8409-ec3624d06e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d01fae3509844e499bcef4cc311d4b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fc98c089-ddc4-4fdc-bdde-09605fabe865,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:46:50Z,use_quota=True,user_id='73c9543ee60d4e3cb9dfcd8e50615b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369fb41c-c67d-466e-9719-aff79ae9f7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369fb41c-c67d-466e-9719-aff79ae9f7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd37c60-8798-49cb-afc9-c51c30eff593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd37c60-8798-49cb-afc9-c51c30eff593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b5892c2f-017c-455b-8409-ec3624d06e11', 'volume_name': 'volume-b5892c2f-017c-455b-8409-ec3624d06e11', 'volume_size': 1, 'snapshot_id': 'fc98c089-ddc4-4fdc-bdde-09605fabe865'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788f82b7-6628-46e6-926e-bb4e211987fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788f82b7-6628-46e6-926e-bb4e211987fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3b520e-b813-42e7-a683-0ba2b8f4e630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:50 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Volume b5892c2f-017c-455b-8409-ec3624d06e11: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b5892c2f-017c-455b-8409-ec3624d06e11', 'volume_size': 1, 'snapshot_id': 'fc98c089-ddc4-4fdc-bdde-09605fabe865'} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Acquiring lock "cinder-quobyte-fc98c089-ddc4-4fdc-bdde-09605fabe865-b5892c2f-017c-455b-8409-ec3624d06e11" by "_create_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Lock "cinder-quobyte-fc98c089-ddc4-4fdc-bdde-09605fabe865-b5892c2f-017c-455b-8409-ec3624d06e11" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Creating volume b5892c2f-017c-455b-8409-ec3624d06e11 from snapshot fc98c089-ddc4-4fdc-bdde-09605fabe865 {{(pid=86085) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Acquiring lock "cinder-quobyte-b5892c2f-017c-455b-8409-ec3624d06e11" by "_copy_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Lock "cinder-quobyte-b5892c2f-017c-455b-8409-ec3624d06e11" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] snapshot: fc98c089-ddc4-4fdc-bdde-09605fabe865, volume: b5892c2f-017c-455b-8409-ec3624d06e11, {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_3omc22andevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 12:46:50 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Image download 20.69 MB at 20.69 MB/s Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[82222d87-45f6-4c17-9c56-9bdfd8821e1c]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[574dca6e-30d1-461f-9484-b3fa1be3ac62]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:46:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_3omc22andevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:50 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865 Sep 23 12:46:50 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:50 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_3omc22andevstack@QuobyteHD Sep 23 12:46:50 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:51 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:51 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865" returned: 0 in 0.546s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_3omc22andevstack@QuobyteHD" returned: 0 in 0.517s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e3fe179-7d87-41ef-a5de-a5ca32371558(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:46:51 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Temporary image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 is fetched for user cc72f608405d4b1894f5e0097d9d4c61. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 12:46:51 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bd7d08-5eb6-41bd-9c15-08669428d2a5]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:46:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:51 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad54bad8-03a0-4492-be65-859b437eddd9]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:46:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_3omc22andevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:51 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 Sep 23 12:46:51 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:51 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_3omc22andevstack@QuobyteHD Sep 23 12:46:51 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:51 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_3omc22andevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:46:51 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Sep 23 12:46:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558" returned: 0 in 0.592s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:46:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] will copy from snapshot at /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 12:46:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Creating direct copy from snapshot {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 12:46:51 devstack cinder-volume[86085]: DEBUG cinder.utils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Path /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5892c2f-017c-455b-8409-ec3624d06e11 not found in is_blk_device check {{(pid=86085) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 12:46:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5892c2f-017c-455b-8409-ec3624d06e11 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:46:51 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5892c2f-017c-455b-8409-ec3624d06e11 Sep 23 12:46:51 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:46:53 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:46:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Flow 'volume_create_manager' (604f96d8-7df3-445d-bc7d-5c0b0620b7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:46:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f180d859-7199-4861-8d0e-c24e98a47f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f180d859-7199-4861-8d0e-c24e98a47f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1955225575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d629bc2-ee3c-4149-9502-73415f8c998c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513c54ba495a4a3cb2e4b1ca87b629c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:46:54Z,use_quota=True,user_id='4af08fd4551e44a58a926debf3bef550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:46:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9bfca2d-c56e-4f9f-8552-d6f63a34b198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9bfca2d-c56e-4f9f-8552-d6f63a34b198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:46:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54062aa1-eab8-45b1-adf1-a2e767bdac88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54062aa1-eab8-45b1-adf1-a2e767bdac88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d629bc2-ee3c-4149-9502-73415f8c998c', 'volume_name': 'volume-4d629bc2-ee3c-4149-9502-73415f8c998c', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:46:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255605e9-c894-4046-ad3c-2372d383b341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255605e9-c894-4046-ad3c-2372d383b341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:46:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eeb250a-89c7-4f94-87f1-a5ac8f18ba03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:46:54 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Volume 4d629bc2-ee3c-4149-9502-73415f8c998c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d629bc2-ee3c-4149-9502-73415f8c998c', 'volume_size': 1} Sep 23 12:46:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:01 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5892c2f-017c-455b-8409-ec3624d06e11" returned: 0 in 10.135s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Image conversion details: src /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558, size 1024.00 MB, duration 10.14 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5892c2f-017c-455b-8409-ec3624d06e11 {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:47:02 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Converted 1024.00 MB image at 101.02 MB/s Sep 23 12:47:02 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5892c2f-017c-455b-8409-ec3624d06e11 is being set with open permissions: ugo+rw Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5892c2f-017c-455b-8409-ec3624d06e11 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:02 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5892c2f-017c-455b-8409-ec3624d06e11 Sep 23 12:47:02 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:02 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5892c2f-017c-455b-8409-ec3624d06e11" returned: 0 in 0.399s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Lock "cinder-quobyte-b5892c2f-017c-455b-8409-ec3624d06e11" released by "_copy_volume_from_snapshot" :: held 11.872s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Lock "cinder-quobyte-fc98c089-ddc4-4fdc-bdde-09605fabe865-b5892c2f-017c-455b-8409-ec3624d06e11" released by "_create_volume_from_snapshot" :: held 11.983s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.674s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-50980562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe155ffd-3136-465a-9d87-8500fe1d8f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831edd3b4bc743668db11f403e5a4431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:46:49Z,use_quota=True,user_id='cc72f608405d4b1894f5e0097d9d4c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Creating volume fe155ffd-3136-465a-9d87-8500fe1d8f7e {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:47:02 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:02 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e 1073741824 Sep 23 12:47:02 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3b520e-b813-42e7-a683-0ba2b8f4e630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5892c2f-017c-455b-8409-ec3624d06e11', 'volume_size': 1, 'snapshot_id': 'fc98c089-ddc4-4fdc-bdde-09605fabe865'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8208fe0f-5640-4ed3-8d11-8956c1ef9fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:02 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Volume volume-b5892c2f-017c-455b-8409-ec3624d06e11 (b5892c2f-017c-455b-8409-ec3624d06e11): created successfully Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8208fe0f-5640-4ed3-8d11-8956c1ef9fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Flow 'volume_create_manager' (077b61e5-df44-423f-8d76-170bbaaae4f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:47:02 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-a58a5edf-1372-4b1e-af59-cafbac9f24b7 tempest-TestStampPattern-1792644428 None] Created volume successfully. Sep 23 12:47:03 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e 1073741824" returned: 0 in 0.855s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:03 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e Sep 23 12:47:03 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:03 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e" returned: 0 in 0.262s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:47:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.356s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1955225575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d629bc2-ee3c-4149-9502-73415f8c998c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513c54ba495a4a3cb2e4b1ca87b629c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:46:54Z,use_quota=True,user_id='4af08fd4551e44a58a926debf3bef550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:47:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Creating volume 4d629bc2-ee3c-4149-9502-73415f8c998c {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:47:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:47:03 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:47:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:03 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c 1073741824 Sep 23 12:47:03 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:03 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Attempting download of 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}])) to volume fe155ffd-3136-465a-9d87-8500fe1d8f7e. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 12:47:03 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a78eb4-58e8-4f0e-89c0-cd2b446d0edf]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_izt5278x {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:03 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_izt5278x Sep 23 12:47:03 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:04 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_izt5278x" returned: 0 in 0.506s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_izt5278x {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:04 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c 1073741824" returned: 0 in 0.672s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:04 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c Sep 23 12:47:04 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:04 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_izt5278x Sep 23 12:47:04 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:04 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_izt5278x" returned: 1 in 0.439s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_izt5278x' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:47:04 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c0c0b0-8b71-4f71-9840-76ac454f6a63]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_3omc22andevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:04 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c" returned: 0 in 0.409s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:47:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:04 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eeb250a-89c7-4f94-87f1-a5ac8f18ba03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d629bc2-ee3c-4149-9502-73415f8c998c', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:04 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a319aeeb-7545-4c05-8df8-3dadac06a610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:04 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Volume volume-4d629bc2-ee3c-4149-9502-73415f8c998c (4d629bc2-ee3c-4149-9502-73415f8c998c): created successfully Sep 23 12:47:04 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a319aeeb-7545-4c05-8df8-3dadac06a610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:04 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Flow 'volume_create_manager' (604f96d8-7df3-445d-bc7d-5c0b0620b7b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:47:04 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f6187457-dcf7-4d61-a019-cf28541539b0 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Created volume successfully. Sep 23 12:47:05 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_3omc22andevstack@QuobyteHD Sep 23 12:47:05 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:05 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_3omc22andevstack@QuobyteHD" returned: 0 in 0.529s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:05 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 was qcow2, converting to qcow2 {{(pid=86085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 12:47:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_3omc22andevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:05 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_3omc22andevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e Sep 23 12:47:05 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3617a79b-b305-4dfa-8b9f-32e55d47d8d2 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3617a79b-b305-4dfa-8b9f-32e55d47d8d2 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:06 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-3617a79b-b305-4dfa-8b9f-32e55d47d8d2 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Creating offline snapshot c7a3e06e-3c22-4d8c-b437-f366a5a0edc6 of volume 4d629bc2-ee3c-4149-9502-73415f8c998c {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:47:06 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da48526-a96b-4e31-8efe-9726eafa6df4]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3617a79b-b305-4dfa-8b9f-32e55d47d8d2 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:06 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c Sep 23 12:47:06 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:06 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3617a79b-b305-4dfa-8b9f-32e55d47d8d2 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c" returned: 0 in 0.502s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3617a79b-b305-4dfa-8b9f-32e55d47d8d2 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:06 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6 1G Sep 23 12:47:06 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:07 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3617a79b-b305-4dfa-8b9f-32e55d47d8d2 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6 1G" returned: 0 in 0.868s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3617a79b-b305-4dfa-8b9f-32e55d47d8d2 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d629bc2-ee3c-4149-9502-73415f8c998c -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:07 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d629bc2-ee3c-4149-9502-73415f8c998c -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6 Sep 23 12:47:07 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:08 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_3omc22andevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e" returned: 0 in 2.763s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:08 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_3omc22andevstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:47:08 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Converted 112.00 MB image at 40.52 MB/s Sep 23 12:47:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:08 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e 1G Sep 23 12:47:08 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:08 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3617a79b-b305-4dfa-8b9f-32e55d47d8d2 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d629bc2-ee3c-4149-9502-73415f8c998c -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6" returned: 0 in 0.539s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:08 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-3617a79b-b305-4dfa-8b9f-32e55d47d8d2 tempest-CreateVolumesFromSnapshotTest-1317627279 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6 is being set with open permissions: ugo+rw Sep 23 12:47:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3617a79b-b305-4dfa-8b9f-32e55d47d8d2 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:08 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6 Sep 23 12:47:08 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:08 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e 1G" returned: 0 in 0.632s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:08 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Downloaded image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}])) to volume fe155ffd-3136-465a-9d87-8500fe1d8f7e successfully. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 12:47:08 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Temporary image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 for user cc72f608405d4b1894f5e0097d9d4c61 is deleted. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 12:47:08 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Marking volume fe155ffd-3136-465a-9d87-8500fe1d8f7e as bootable. {{(pid=86085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 12:47:08 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Copying metadata from image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 to fe155ffd-3136-465a-9d87-8500fe1d8f7e. {{(pid=86085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 12:47:08 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Creating volume glance metadata for volume fe155ffd-3136-465a-9d87-8500fe1d8f7e backed by image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 12:47:08 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3617a79b-b305-4dfa-8b9f-32e55d47d8d2 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6" returned: 0 in 0.551s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3617a79b-b305-4dfa-8b9f-32e55d47d8d2 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:08 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.info Sep 23 12:47:08 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:09 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd4c1b6-a672-46e4-843e-3eb410d8a1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e', 'volume_size': 1, 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3c5121b794a4715babb77a8b7da12a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'created_at': datetime.datetime(2026, 9, 23, 10, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 27, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:09 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455d453a-1196-44cb-a884-f79562a51f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:09 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Volume volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e (fe155ffd-3136-465a-9d87-8500fe1d8f7e): created successfully Sep 23 12:47:09 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455d453a-1196-44cb-a884-f79562a51f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:09 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Flow 'volume_create_manager' (2c2b08a2-397f-4ee5-a180-9c3f6b61f239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:47:09 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-c4d4c876-cefa-4f89-8728-547b7e305a61 tempest-TestShelveInstance-635120961 None] Created volume successfully. Sep 23 12:47:09 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3617a79b-b305-4dfa-8b9f-32e55d47d8d2 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.info" returned: 0 in 0.457s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:09 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-3617a79b-b305-4dfa-8b9f-32e55d47d8d2 tempest-CreateVolumesFromSnapshotTest-1317627279 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.info is being set with open permissions: ugo+rw Sep 23 12:47:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3617a79b-b305-4dfa-8b9f-32e55d47d8d2 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:09 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.info Sep 23 12:47:09 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:09 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3617a79b-b305-4dfa-8b9f-32e55d47d8d2 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.info" returned: 0 in 0.386s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3617a79b-b305-4dfa-8b9f-32e55d47d8d2 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.452s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:09 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-3617a79b-b305-4dfa-8b9f-32e55d47d8d2 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Create snapshot completed successfully Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Flow 'volume_create_manager' (e0532daa-c096-4298-8d72-043f4a48e6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418cf1b7-72b4-4aaf-851f-47a13ebfb760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418cf1b7-72b4-4aaf-851f-47a13ebfb760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1574035066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20813d30-18ff-4bcf-87c7-d1075a3ef204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513c54ba495a4a3cb2e4b1ca87b629c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:47:11Z,use_quota=True,user_id='4af08fd4551e44a58a926debf3bef550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbcb4f8d-42cb-4767-b33f-a8177421d2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbcb4f8d-42cb-4767-b33f-a8177421d2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce6f9e2-45bc-4cbd-b949-a007cec69a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce6f9e2-45bc-4cbd-b949-a007cec69a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20813d30-18ff-4bcf-87c7-d1075a3ef204', 'volume_name': 'volume-20813d30-18ff-4bcf-87c7-d1075a3ef204', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da994d62-4005-4d3c-b82a-88c04a1ec6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da994d62-4005-4d3c-b82a-88c04a1ec6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d18423-43f9-4ad5-8c8b-8b38299f01ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:11 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Volume 20813d30-18ff-4bcf-87c7-d1075a3ef204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20813d30-18ff-4bcf-87c7-d1075a3ef204', 'volume_size': 1} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1574035066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20813d30-18ff-4bcf-87c7-d1075a3ef204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513c54ba495a4a3cb2e4b1ca87b629c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:47:11Z,use_quota=True,user_id='4af08fd4551e44a58a926debf3bef550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Creating volume 20813d30-18ff-4bcf-87c7-d1075a3ef204 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:47:11 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:47:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-20813d30-18ff-4bcf-87c7-d1075a3ef204 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:11 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-20813d30-18ff-4bcf-87c7-d1075a3ef204 1073741824 Sep 23 12:47:11 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:12 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:47:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Flow 'volume_create_manager' (a5960490-9eca-48d5-8c0a-9acc86b0155a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:47:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0652a8fa-8fef-4e51-a55d-2753549f32cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0652a8fa-8fef-4e51-a55d-2753549f32cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-674801727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c23ec32-bb02-4999-80e4-d3cf261dac69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513c54ba495a4a3cb2e4b1ca87b629c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:47:12Z,use_quota=True,user_id='4af08fd4551e44a58a926debf3bef550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e26e3ab-f00e-417d-8ed7-034a4360ddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e26e3ab-f00e-417d-8ed7-034a4360ddd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f090076-0075-466d-b027-1b96c327985d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f090076-0075-466d-b027-1b96c327985d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c23ec32-bb02-4999-80e4-d3cf261dac69', 'volume_name': 'volume-3c23ec32-bb02-4999-80e4-d3cf261dac69', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dee7bcf-9f49-4b1e-a7f1-c9c95031cb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dee7bcf-9f49-4b1e-a7f1-c9c95031cb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32dc96b-11e9-4f31-99f7-242750338295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:12 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Volume 3c23ec32-bb02-4999-80e4-d3cf261dac69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c23ec32-bb02-4999-80e4-d3cf261dac69', 'volume_size': 1} Sep 23 12:47:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:12 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-20813d30-18ff-4bcf-87c7-d1075a3ef204 1073741824" returned: 0 in 0.973s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-20813d30-18ff-4bcf-87c7-d1075a3ef204 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:13 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-20813d30-18ff-4bcf-87c7-d1075a3ef204 Sep 23 12:47:13 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Flow 'volume_create_manager' (d24e306b-cfad-4461-97d3-2e569022cde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:47:13 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7007fba-f8ea-4b69-9310-e0574cc6cb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-20813d30-18ff-4bcf-87c7-d1075a3ef204" returned: 0 in 0.433s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.870s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-674801727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c23ec32-bb02-4999-80e4-d3cf261dac69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513c54ba495a4a3cb2e4b1ca87b629c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:47:12Z,use_quota=True,user_id='4af08fd4551e44a58a926debf3bef550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Creating volume 3c23ec32-bb02-4999-80e4-d3cf261dac69 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:47:13 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3c23ec32-bb02-4999-80e4-d3cf261dac69 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:13 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3c23ec32-bb02-4999-80e4-d3cf261dac69 1073741824 Sep 23 12:47:13 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7007fba-f8ea-4b69-9310-e0574cc6cb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-152247450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb9e879-974a-4e66-88de-4cbb52e554e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513c54ba495a4a3cb2e4b1ca87b629c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:47:13Z,use_quota=True,user_id='4af08fd4551e44a58a926debf3bef550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d2aff4-c0a2-4aa0-87b3-10eb4460c302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d2aff4-c0a2-4aa0-87b3-10eb4460c302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80a671d-05ef-4751-973d-cb904d1fed3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80a671d-05ef-4751-973d-cb904d1fed3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bb9e879-974a-4e66-88de-4cbb52e554e9', 'volume_name': 'volume-0bb9e879-974a-4e66-88de-4cbb52e554e9', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3858cc5-2faf-4479-9913-b3b30b2c0203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3858cc5-2faf-4479-9913-b3b30b2c0203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2730bd-c668-4824-8cb3-8f461cafcd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:13 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Volume 0bb9e879-974a-4e66-88de-4cbb52e554e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bb9e879-974a-4e66-88de-4cbb52e554e9', 'volume_size': 1} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d18423-43f9-4ad5-8c8b-8b38299f01ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20813d30-18ff-4bcf-87c7-d1075a3ef204', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9627c9-a902-4d37-bf77-381bf899561e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:13 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Volume volume-20813d30-18ff-4bcf-87c7-d1075a3ef204 (20813d30-18ff-4bcf-87c7-d1075a3ef204): created successfully Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9627c9-a902-4d37-bf77-381bf899561e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Flow 'volume_create_manager' (e0532daa-c096-4298-8d72-043f4a48e6bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:47:13 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-fc1c6e66-da84-4b05-80ca-644c80c26060 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Created volume successfully. Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=62,cinder:UPDATE=52,cinder:INSERT=16,cinder:DELETE=6 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Flow 'volume_create_manager' (227c1ce1-556d-4a72-8d47-4056db5e4e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4218c87-c2bf-4429-b231-44be79bbf7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4218c87-c2bf-4429-b231-44be79bbf7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-313838861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=579f617a-a02a-4d16-8c6f-279d30e3cd95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513c54ba495a4a3cb2e4b1ca87b629c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:47:14Z,use_quota=True,user_id='4af08fd4551e44a58a926debf3bef550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d923ea-e02b-49c8-a59a-c66724b5c81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d923ea-e02b-49c8-a59a-c66724b5c81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58079bf0-258e-4d96-9421-a7951c53fdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58079bf0-258e-4d96-9421-a7951c53fdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '579f617a-a02a-4d16-8c6f-279d30e3cd95', 'volume_name': 'volume-579f617a-a02a-4d16-8c6f-279d30e3cd95', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25d0a8a-cf41-4e61-9b64-7be5eb2b018f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25d0a8a-cf41-4e61-9b64-7be5eb2b018f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b9c997-4bd1-47f2-9536-a1b99dc6a46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:14 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Volume 579f617a-a02a-4d16-8c6f-279d30e3cd95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-579f617a-a02a-4d16-8c6f-279d30e3cd95', 'volume_size': 1} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:14 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3c23ec32-bb02-4999-80e4-d3cf261dac69 1073741824" returned: 0 in 1.091s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3c23ec32-bb02-4999-80e4-d3cf261dac69 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:14 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3c23ec32-bb02-4999-80e4-d3cf261dac69 Sep 23 12:47:14 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Flow 'volume_create_manager' (1d8496a2-d37e-4e9f-a941-cf41c655682d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8182454f-a8e9-4113-b6e2-3438c3dc6cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8182454f-a8e9-4113-b6e2-3438c3dc6cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1873865023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513c54ba495a4a3cb2e4b1ca87b629c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:47:15Z,use_quota=True,user_id='4af08fd4551e44a58a926debf3bef550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296491fb-4ffe-4c46-b78e-19446314a95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296491fb-4ffe-4c46-b78e-19446314a95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fa09da-4dfc-4fba-b8d6-4a631104b846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fa09da-4dfc-4fba-b8d6-4a631104b846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5', 'volume_name': 'volume-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b86770e-1ee4-4a81-bcf2-2f6303f529bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b86770e-1ee4-4a81-bcf2-2f6303f529bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cb1606-3656-4ce4-85be-5dbb863c4c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:15 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Volume bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5', 'volume_size': 1} Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:15 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3c23ec32-bb02-4999-80e4-d3cf261dac69" returned: 0 in 0.606s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.514s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-152247450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb9e879-974a-4e66-88de-4cbb52e554e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513c54ba495a4a3cb2e4b1ca87b629c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:47:13Z,use_quota=True,user_id='4af08fd4551e44a58a926debf3bef550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Creating volume 0bb9e879-974a-4e66-88de-4cbb52e554e9 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:47:15 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0bb9e879-974a-4e66-88de-4cbb52e554e9 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=62,cinder:UPDATE=47,cinder:INSERT=13,cinder:DELETE=3 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:47:15 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0bb9e879-974a-4e66-88de-4cbb52e554e9 1073741824 Sep 23 12:47:15 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32dc96b-11e9-4f31-99f7-242750338295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c23ec32-bb02-4999-80e4-d3cf261dac69', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d70359-1e75-40de-b6db-296a36a08fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:15 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Volume volume-3c23ec32-bb02-4999-80e4-d3cf261dac69 (3c23ec32-bb02-4999-80e4-d3cf261dac69): created successfully Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d70359-1e75-40de-b6db-296a36a08fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Flow 'volume_create_manager' (a5960490-9eca-48d5-8c0a-9acc86b0155a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:47:15 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d46c8e32-61c2-4b0e-b239-27a5b1a9617f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Created volume successfully. Sep 23 12:47:16 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0bb9e879-974a-4e66-88de-4cbb52e554e9 1073741824" returned: 0 in 0.897s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0bb9e879-974a-4e66-88de-4cbb52e554e9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-3efd0b2d-bd97-45a5-b623-5a2a667d4389 req-9f7c6493-b318-42a9-ab42-91617278bd00 tempest-TestShelveInstance-635120961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:16 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0bb9e879-974a-4e66-88de-4cbb52e554e9 Sep 23 12:47:16 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:16 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0bb9e879-974a-4e66-88de-4cbb52e554e9" returned: 0 in 0.278s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.176s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-313838861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=579f617a-a02a-4d16-8c6f-279d30e3cd95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513c54ba495a4a3cb2e4b1ca87b629c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:47:14Z,use_quota=True,user_id='4af08fd4551e44a58a926debf3bef550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Creating volume 579f617a-a02a-4d16-8c6f-279d30e3cd95 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:47:16 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-579f617a-a02a-4d16-8c6f-279d30e3cd95 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2730bd-c668-4824-8cb3-8f461cafcd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb9e879-974a-4e66-88de-4cbb52e554e9', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:16 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-579f617a-a02a-4d16-8c6f-279d30e3cd95 1073741824 Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e7604d-4018-41ce-abbc-f2c784543911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:16 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:16 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Volume volume-0bb9e879-974a-4e66-88de-4cbb52e554e9 (0bb9e879-974a-4e66-88de-4cbb52e554e9): created successfully Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e7604d-4018-41ce-abbc-f2c784543911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Flow 'volume_create_manager' (d24e306b-cfad-4461-97d3-2e569022cde3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:47:16 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-7853b4a2-f1b9-448b-86e0-dc9352122e5a tempest-CreateVolumesFromSnapshotTest-1317627279 None] Created volume successfully. Sep 23 12:47:17 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-579f617a-a02a-4d16-8c6f-279d30e3cd95 1073741824" returned: 0 in 0.700s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-579f617a-a02a-4d16-8c6f-279d30e3cd95 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:17 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-579f617a-a02a-4d16-8c6f-279d30e3cd95 Sep 23 12:47:17 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:17 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-579f617a-a02a-4d16-8c6f-279d30e3cd95" returned: 0 in 0.404s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:47:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.637s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1873865023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513c54ba495a4a3cb2e4b1ca87b629c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:47:15Z,use_quota=True,user_id='4af08fd4551e44a58a926debf3bef550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:47:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Creating volume bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:47:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:47:17 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:47:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b9c997-4bd1-47f2-9536-a1b99dc6a46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-579f617a-a02a-4d16-8c6f-279d30e3cd95', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d79e37f-8ec4-4df8-a07a-1f259f78abe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:17 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5 1073741824 Sep 23 12:47:17 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:17 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Volume volume-579f617a-a02a-4d16-8c6f-279d30e3cd95 (579f617a-a02a-4d16-8c6f-279d30e3cd95): created successfully Sep 23 12:47:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d79e37f-8ec4-4df8-a07a-1f259f78abe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Flow 'volume_create_manager' (227c1ce1-556d-4a72-8d47-4056db5e4e84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:47:17 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-5335da9b-b1d5-408c-a3fe-cebbf778acd4 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Created volume successfully. Sep 23 12:47:18 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5 1073741824" returned: 0 in 0.681s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:18 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5 Sep 23 12:47:18 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:18 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5" returned: 0 in 0.292s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:47:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-3efd0b2d-bd97-45a5-b623-5a2a667d4389 req-9f7c6493-b318-42a9-ab42-91617278bd00 tempest-TestShelveInstance-635120961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.479s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-3efd0b2d-bd97-45a5-b623-5a2a667d4389 req-9f7c6493-b318-42a9-ab42-91617278bd00 tempest-TestShelveInstance-635120961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cb1606-3656-4ce4-85be-5dbb863c4c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6252ac6-e34c-4286-a361-892db7d49bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:18 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Volume volume-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5 (bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5): created successfully Sep 23 12:47:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6252ac6-e34c-4286-a361-892db7d49bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Flow 'volume_create_manager' (1d8496a2-d37e-4e9f-a941-cf41c655682d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:47:18 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-85ad34f5-b141-4989-882d-c2835a526290 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Created volume successfully. Sep 23 12:47:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-3efd0b2d-bd97-45a5-b623-5a2a667d4389 req-9f7c6493-b318-42a9-ab42-91617278bd00 tempest-TestShelveInstance-635120961 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'faf45f38-b885-4fe8-9a12-5e315ba20573', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:47:18 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-3efd0b2d-bd97-45a5-b623-5a2a667d4389 req-9f7c6493-b318-42a9-ab42-91617278bd00 tempest-TestShelveInstance-635120961 None] attachment_update completed successfully. Sep 23 12:47:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "cinder-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "cinder-quobyte-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-quobyte-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5" acquired by "delete_volume" :: waited 0.030s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:19 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[41775fab-830c-478d-ade1-9a67e6ae48ee]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:20 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5 Sep 23 12:47:20 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:20 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5" returned: 0 in 0.749s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:20 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5 Sep 23 12:47:20 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:20 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5" returned: 0 in 0.447s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:20 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-quobyte-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5" released by "delete_volume" :: held 1.302s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:21 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Created reservations ['a3486d27-b0f9-4cc6-a503-7f1ce3c4f596', '2dfc0e74-861e-43db-a447-2407fb651a59', 'cd78d121-4e11-4c95-a148-764f59d65fc8', '7e00beb2-625c-4904-97b0-972a4ea5bd03'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:47:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:21 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:47:21 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:21 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.381s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:21 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:47:21 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Deleted volume successfully. Sep 23 12:47:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5bdc3e21-ba30-45f2-8627-e0a250a89cf3 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-bd06aaf6-ec7e-48ed-aeec-8ac6e26787d5-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "cinder-579f617a-a02a-4d16-8c6f-279d30e3cd95-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-579f617a-a02a-4d16-8c6f-279d30e3cd95-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "cinder-quobyte-579f617a-a02a-4d16-8c6f-279d30e3cd95" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-quobyte-579f617a-a02a-4d16-8c6f-279d30e3cd95" acquired by "delete_volume" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:22 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9eee5f4-d198-476d-b6b6-55940812298c]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-579f617a-a02a-4d16-8c6f-279d30e3cd95 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:22 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-579f617a-a02a-4d16-8c6f-279d30e3cd95 Sep 23 12:47:22 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:22 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-579f617a-a02a-4d16-8c6f-279d30e3cd95" returned: 0 in 0.500s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-579f617a-a02a-4d16-8c6f-279d30e3cd95 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:22 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-579f617a-a02a-4d16-8c6f-279d30e3cd95 Sep 23 12:47:22 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:23 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-579f617a-a02a-4d16-8c6f-279d30e3cd95" returned: 0 in 0.301s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-quobyte-579f617a-a02a-4d16-8c6f-279d30e3cd95" released by "delete_volume" :: held 0.899s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:23 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Created reservations ['8750fb57-4534-4e88-90cf-423d62ed441c', 'aed1cbd7-9695-48fb-b7a7-8530990ddd74', 'bd31e882-3e8c-4e17-8a9e-edac945482f2', 'fd14319e-e525-463b-9f15-c21357c80fe3'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:47:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:23 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:47:23 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "cinder-0bb9e879-974a-4e66-88de-4cbb52e554e9-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-0bb9e879-974a-4e66-88de-4cbb52e554e9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "cinder-quobyte-0bb9e879-974a-4e66-88de-4cbb52e554e9" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-quobyte-0bb9e879-974a-4e66-88de-4cbb52e554e9" acquired by "delete_volume" :: waited 0.056s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:23 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2c74cd-4d4c-414d-8d78-adc308918da8]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0bb9e879-974a-4e66-88de-4cbb52e554e9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:23 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0bb9e879-974a-4e66-88de-4cbb52e554e9 Sep 23 12:47:23 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:23 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.461s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:23 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:47:23 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Deleted volume successfully. Sep 23 12:47:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1e5e9d7b-18a7-4c22-b0c0-0728216981c6 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-579f617a-a02a-4d16-8c6f-279d30e3cd95-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:24 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0bb9e879-974a-4e66-88de-4cbb52e554e9" returned: 0 in 0.609s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0bb9e879-974a-4e66-88de-4cbb52e554e9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:24 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0bb9e879-974a-4e66-88de-4cbb52e554e9 Sep 23 12:47:24 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:24 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0bb9e879-974a-4e66-88de-4cbb52e554e9" returned: 0 in 0.313s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-quobyte-0bb9e879-974a-4e66-88de-4cbb52e554e9" released by "delete_volume" :: held 1.028s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:24 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] Created reservations ['433d602b-cad3-40ff-9f19-19917094462c', 'f02745bd-f9b2-4ee0-b558-0e2725fb461c', 'db30f95c-6a6d-47ff-a1be-47b38ea2ef9c', '8b9ae48f-d2fd-4a73-9747-93f1617b52d3'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:47:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:24 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:47:24 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:25 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.387s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:25 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:47:25 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] Deleted volume successfully. Sep 23 12:47:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-80a52488-b77e-4b5a-a197-051e5deb379e tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-0bb9e879-974a-4e66-88de-4cbb52e554e9-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "cinder-3c23ec32-bb02-4999-80e4-d3cf261dac69-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-3c23ec32-bb02-4999-80e4-d3cf261dac69-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "cinder-quobyte-3c23ec32-bb02-4999-80e4-d3cf261dac69" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-quobyte-3c23ec32-bb02-4999-80e4-d3cf261dac69" acquired by "delete_volume" :: waited 0.024s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:25 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81a5c72-4038-4b7a-bccf-afb029f4db93]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3c23ec32-bb02-4999-80e4-d3cf261dac69 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:26 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3c23ec32-bb02-4999-80e4-d3cf261dac69 Sep 23 12:47:26 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:26 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3c23ec32-bb02-4999-80e4-d3cf261dac69" returned: 0 in 0.775s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3c23ec32-bb02-4999-80e4-d3cf261dac69 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:26 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3c23ec32-bb02-4999-80e4-d3cf261dac69 Sep 23 12:47:26 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:27 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3c23ec32-bb02-4999-80e4-d3cf261dac69" returned: 0 in 0.477s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-quobyte-3c23ec32-bb02-4999-80e4-d3cf261dac69" released by "delete_volume" :: held 1.332s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:27 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] Created reservations ['9b91ca19-b40f-4d3a-b35b-3e7a81245760', '5ee732b9-7f5a-4cb0-acb4-11153af1e9ef', 'cebe2a38-5ab6-48e5-8f5d-9bc12cab8a91', 'fa86379e-3be3-478f-a556-af129252b894'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:47:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:27 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:47:27 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:27 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.321s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:27 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:47:27 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] Deleted volume successfully. Sep 23 12:47:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a1065038-83ff-45d8-926d-cb628bb593ed tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-3c23ec32-bb02-4999-80e4-d3cf261dac69-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:28 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "cinder-20813d30-18ff-4bcf-87c7-d1075a3ef204-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:28 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-20813d30-18ff-4bcf-87c7-d1075a3ef204-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:28 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "cinder-quobyte-20813d30-18ff-4bcf-87c7-d1075a3ef204" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:28 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-quobyte-20813d30-18ff-4bcf-87c7-d1075a3ef204" acquired by "delete_volume" :: waited 0.027s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:28 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d287172b-5ef6-414e-8c30-f16563379eb5]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-20813d30-18ff-4bcf-87c7-d1075a3ef204 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:28 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-20813d30-18ff-4bcf-87c7-d1075a3ef204 Sep 23 12:47:28 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:28 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-20813d30-18ff-4bcf-87c7-d1075a3ef204" returned: 0 in 0.607s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-20813d30-18ff-4bcf-87c7-d1075a3ef204 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:28 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-20813d30-18ff-4bcf-87c7-d1075a3ef204 Sep 23 12:47:28 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:29 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-20813d30-18ff-4bcf-87c7-d1075a3ef204" returned: 0 in 0.435s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:29 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-quobyte-20813d30-18ff-4bcf-87c7-d1075a3ef204" released by "delete_volume" :: held 1.120s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:29 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] Created reservations ['0d27fcfd-3b84-421d-8225-219bc8e0a0d6', '40e629e7-7e74-472a-9469-35de7cc48404', '09d8df89-9aef-4cd6-a8b7-306f0b9127ed', '2a92a1f2-b7a6-4f88-ad3c-d2b673d63c2b'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:47:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:29 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:29 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:29 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:47:29 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:30 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.513s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:30 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:47:30 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] Deleted volume successfully. Sep 23 12:47:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0ff8b725-e700-47db-8246-bee9d94a31ef tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-20813d30-18ff-4bcf-87c7-d1075a3ef204-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "cinder-c7a3e06e-3c22-4d8c-b437-f366a5a0edc6-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-c7a3e06e-3c22-4d8c-b437-f366a5a0edc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "cinder-quobyte-4d629bc2-ee3c-4149-9502-73415f8c998c" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-quobyte-4d629bc2-ee3c-4149-9502-73415f8c998c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "cinder-quobyte-c7a3e06e-3c22-4d8c-b437-f366a5a0edc6" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-quobyte-c7a3e06e-3c22-4d8c-b437-f366a5a0edc6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:30 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Deleting offline snapshot c7a3e06e-3c22-4d8c-b437-f366a5a0edc6 of volume 4d629bc2-ee3c-4149-9502-73415f8c998c {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:47:30 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] snapshot_file for this snap is: volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:47:30 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff8575c-6a0f-4d4c-a705-e0acc53c8c17]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:30 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6 Sep 23 12:47:30 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:31 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6" returned: 0 in 0.459s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:31 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d629bc2-ee3c-4149-9502-73415f8c998c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:47:31 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e06bffa-5af4-4e9d-8b02-f8ac8ea6eeec]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:31 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c Sep 23 12:47:31 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:31 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c" returned: 0 in 0.484s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:31 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6 Sep 23 12:47:31 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:32 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6" returned: 0 in 0.512s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:32 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6 Sep 23 12:47:32 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:32 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c.c7a3e06e-3c22-4d8c-b437-f366a5a0edc6" returned: 0 in 0.304s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-quobyte-c7a3e06e-3c22-4d8c-b437-f366a5a0edc6" released by "_delete_snapshot" :: held 1.905s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-quobyte-4d629bc2-ee3c-4149-9502-73415f8c998c" released by "delete_snapshot" :: held 1.939s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:32 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Created reservations ['0792933e-1289-4f02-b60c-b987767f92c7', 'bafe46de-3912-4995-b32c-cc0fe481a5c2', '954f75a5-f3b1-43c5-97d7-02eee010843b', 'c906834d-c9a5-4749-afc1-b9b7a513b86b'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:47:32 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Delete snapshot completed successfully. Sep 23 12:47:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-71979397-25b7-4fae-85e4-8bb7723a5390 tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-c7a3e06e-3c22-4d8c-b437-f366a5a0edc6-delete_snapshot" released by "delete_snapshot" :: held 2.281s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-34e2b795-502b-4d20-8152-b468d58f82d5 req-d9c7a412-1f73-4de1-9b86-81275da620b1 tempest-TestStampPattern-1792644428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-34e2b795-502b-4d20-8152-b468d58f82d5 req-d9c7a412-1f73-4de1-9b86-81275da620b1 tempest-TestStampPattern-1792644428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-34e2b795-502b-4d20-8152-b468d58f82d5 req-d9c7a412-1f73-4de1-9b86-81275da620b1 tempest-TestStampPattern-1792644428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-34e2b795-502b-4d20-8152-b468d58f82d5 req-d9c7a412-1f73-4de1-9b86-81275da620b1 tempest-TestStampPattern-1792644428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-b5892c2f-017c-455b-8409-ec3624d06e11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6470d02b-1676-4b20-91f9-9e5961501673', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:47:33 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-34e2b795-502b-4d20-8152-b468d58f82d5 req-d9c7a412-1f73-4de1-9b86-81275da620b1 tempest-TestStampPattern-1792644428 None] attachment_update completed successfully. Sep 23 12:47:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "cinder-4d629bc2-ee3c-4149-9502-73415f8c998c-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-4d629bc2-ee3c-4149-9502-73415f8c998c-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "cinder-quobyte-4d629bc2-ee3c-4149-9502-73415f8c998c" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-quobyte-4d629bc2-ee3c-4149-9502-73415f8c998c" acquired by "delete_volume" :: waited 0.035s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:34 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[95194522-22c8-4241-a7ad-2851dd4dd5b4]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:34 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c Sep 23 12:47:34 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:35 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c" returned: 0 in 0.637s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:35 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c Sep 23 12:47:35 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:35 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4d629bc2-ee3c-4149-9502-73415f8c998c" returned: 0 in 0.705s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-quobyte-4d629bc2-ee3c-4149-9502-73415f8c998c" released by "delete_volume" :: held 1.505s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:35 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Created reservations ['987e2675-2e5d-4976-9b5a-d62dbbbe6507', '970464c4-4392-4064-bec5-ccde44f0365f', 'cf8eb4b1-ecb5-4d79-8431-e70bcaa0e34b', '440c116f-c5f3-4738-a62e-6dc233bb9bed'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:47:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:36 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:47:36 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:36 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.518s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:36 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:47:36 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Deleted volume successfully. Sep 23 12:47:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a613958e-6b06-4349-8a4b-a07cea76af2f tempest-CreateVolumesFromSnapshotTest-1317627279 None] Lock "cinder-4d629bc2-ee3c-4149-9502-73415f8c998c-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:37 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-f81e1024-98b6-4af5-bf53-7718750add6f req-2c17ca49-1fc5-4edb-8503-1c4d2de7470b tempest-TestStampPattern-1792644428 None] Terminate volume connection completed successfully. Sep 23 12:47:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-f81e1024-98b6-4af5-bf53-7718750add6f req-2c17ca49-1fc5-4edb-8503-1c4d2de7470b tempest-TestStampPattern-1792644428 None] Deleting attachment 6470d02b-1676-4b20-91f9-9e5961501673. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:47:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:47:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:41 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:47:41 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:41 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.450s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:41 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:47:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:47:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:47:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:47:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] Acquiring lock "cinder-b5892c2f-017c-455b-8409-ec3624d06e11-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] Lock "cinder-b5892c2f-017c-455b-8409-ec3624d06e11-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] Acquiring lock "cinder-quobyte-b5892c2f-017c-455b-8409-ec3624d06e11" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] Lock "cinder-quobyte-b5892c2f-017c-455b-8409-ec3624d06e11" acquired by "delete_volume" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:43 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cce128-ae60-4f5d-9b7f-2e117c8c7046]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5892c2f-017c-455b-8409-ec3624d06e11 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:43 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5892c2f-017c-455b-8409-ec3624d06e11 Sep 23 12:47:43 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:44 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5892c2f-017c-455b-8409-ec3624d06e11" returned: 0 in 0.471s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5892c2f-017c-455b-8409-ec3624d06e11 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:44 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5892c2f-017c-455b-8409-ec3624d06e11 Sep 23 12:47:44 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:44 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b5892c2f-017c-455b-8409-ec3624d06e11" returned: 0 in 0.283s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] Lock "cinder-quobyte-b5892c2f-017c-455b-8409-ec3624d06e11" released by "delete_volume" :: held 0.814s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:44 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] Created reservations ['08200fb9-a824-4efb-8f46-a0c8bb448a0f', '50f04cca-8087-4056-b688-d695e396f500', '4c4bf0ec-cba4-4a12-9f87-90c9db9de632', 'df09f0b4-d993-4fd6-9cdd-2f81aead70b9'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:47:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:44 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:44 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:44 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:47:44 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:45 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.642s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:45 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:47:45 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] Deleted volume successfully. Sep 23 12:47:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56764930-c833-42b6-bae7-62702b29bac4 tempest-TestStampPattern-1792644428 None] Lock "cinder-b5892c2f-017c-455b-8409-ec3624d06e11-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] Acquiring lock "cinder-fc98c089-ddc4-4fdc-bdde-09605fabe865-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] Lock "cinder-fc98c089-ddc4-4fdc-bdde-09605fabe865-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] Acquiring lock "cinder-quobyte-8e3fe179-7d87-41ef-a5de-a5ca32371558" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:45 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:47:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Flow 'volume_create_manager' (222862c4-27ac-4686-9c07-2ed670f816ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:47:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3f55b2-0b0d-41e3-8a8f-b159a1731805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] Lock "cinder-quobyte-8e3fe179-7d87-41ef-a5de-a5ca32371558" acquired by "delete_snapshot" :: waited 0.139s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] Acquiring lock "cinder-quobyte-fc98c089-ddc4-4fdc-bdde-09605fabe865" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3f55b2-0b0d-41e3-8a8f-b159a1731805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac1c7eb-ef77-46ba-b190-d36cc9456645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb4fdf6cae8045b09d70cdc562bed89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:47:46Z,use_quota=True,user_id='fa8580c100594433b9d1ba73b4b7b851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09105590-ba80-4b10-b588-70322e2464fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09105590-ba80-4b10-b588-70322e2464fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738d78d5-05dd-478a-95ad-395cd0bf4416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:46 devstack cinder-volume[86085]: DEBUG cinder.image.glance [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Creating Keystone auth plugin from conf {{(pid=86085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 12:47:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] Lock "cinder-quobyte-fc98c089-ddc4-4fdc-bdde-09605fabe865" acquired by "_delete_snapshot" :: waited 0.117s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:46 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] Deleting offline snapshot fc98c089-ddc4-4fdc-bdde-09605fabe865 of volume 8e3fe179-7d87-41ef-a5de-a5ca32371558 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:47:46 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] snapshot_file for this snap is: volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:47:46 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ba41b9-5b00-4129-acd9-7b6cd357de0f]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:46 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865 Sep 23 12:47:46 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738d78d5-05dd-478a-95ad-395cd0bf4416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fac1c7eb-ef77-46ba-b190-d36cc9456645', 'volume_name': 'volume-fac1c7eb-ef77-46ba-b190-d36cc9456645', 'volume_size': 1, 'image_id': '406068e6-a060-45a8-812b-825508a2cad0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/406068e6-a060-45a8-812b-825508a2cad0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e6a47b2a7fe20c4365d6df6066a9385d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eb4fdf6cae8045b09d70cdc562bed89a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '740540eca1778c0293be9d97908d6ddfe99eeb0c13377411116fca6a07d3d4b4c2aabb30ab7679a1923a10e6fcf9c12c920d028780eb8f3216c51b5f50a80b89', 'id': '406068e6-a060-45a8-812b-825508a2cad0', 'created_at': datetime.datetime(2026, 9, 23, 10, 47, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 47, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/406068e6-a060-45a8-812b-825508a2cad0/file', 'properties': {}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b2f499-3298-4c6e-b06e-d39e7348f582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b2f499-3298-4c6e-b06e-d39e7348f582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df529968-2d80-4fa2-90e3-38b312a9fe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:46 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Volume fac1c7eb-ef77-46ba-b190-d36cc9456645: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fac1c7eb-ef77-46ba-b190-d36cc9456645', 'volume_size': 1, 'image_id': '406068e6-a060-45a8-812b-825508a2cad0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/406068e6-a060-45a8-812b-825508a2cad0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e6a47b2a7fe20c4365d6df6066a9385d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eb4fdf6cae8045b09d70cdc562bed89a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '740540eca1778c0293be9d97908d6ddfe99eeb0c13377411116fca6a07d3d4b4c2aabb30ab7679a1923a10e6fcf9c12c920d028780eb8f3216c51b5f50a80b89', 'id': '406068e6-a060-45a8-812b-825508a2cad0', 'created_at': datetime.datetime(2026, 9, 23, 10, 47, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 47, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/406068e6-a060-45a8-812b-825508a2cad0/file', 'properties': {}}, 'image_service': } Sep 23 12:47:46 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Trying to clone fac1c7eb-ef77-46ba-b190-d36cc9456645 from image 406068e6-a060-45a8-812b-825508a2cad0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/406068e6-a060-45a8-812b-825508a2cad0', 'metadata': {}}]). {{(pid=86085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 12:47:46 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 12:47:46 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Image download 0.00 MB at 0.00 MB/s Sep 23 12:47:46 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7362f5-1876-4d72-a992-53c782faca2d]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:46 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865" returned: 0 in 0.581s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:46 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e3fe179-7d87-41ef-a5de-a5ca32371558(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:47:46 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[24838171-c24a-4452-90e4-46462e5fa32a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:46 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD Sep 23 12:47:46 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:46 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 Sep 23 12:47:46 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:47 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD" returned: 0 in 0.511s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:47 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD Sep 23 12:47:47 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:47 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558" returned: 0 in 0.787s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:47 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865 Sep 23 12:47:47 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:47 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD" returned: 1 in 0.564s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:47:47 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Temporary image 406068e6-a060-45a8-812b-825508a2cad0 is fetched for user fa8580c100594433b9d1ba73b4b7b851. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 12:47:47 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ff4892-a3da-4abf-8b81-985a4e70ed10]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:48 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD Sep 23 12:47:48 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:48 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865" returned: 0 in 0.876s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:47:48 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865 Sep 23 12:47:48 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Flow 'volume_create_manager' (ea3d47e5-d664-4981-a859-a417cf975088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (995fc991-9aab-4a6f-b1c7-babdefcf9f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (995fc991-9aab-4a6f-b1c7-babdefcf9f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2010099102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4305742-d850-4351-826b-ab4670450a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c55e88d40c4dd4a504035b48de56f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:47:48Z,use_quota=True,user_id='1af271362d46400b88e9c6cd66d610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cfaacc9-5bd8-4771-83aa-baf6428d30b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cfaacc9-5bd8-4771-83aa-baf6428d30b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae72c57e-62cc-4219-ad1b-7e44c1fb7919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae72c57e-62cc-4219-ad1b-7e44c1fb7919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4305742-d850-4351-826b-ab4670450a52', 'volume_name': 'volume-c4305742-d850-4351-826b-ab4670450a52', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06ff144-a1ef-4d5f-9f3c-8b90208db49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06ff144-a1ef-4d5f-9f3c-8b90208db49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8efa325-a9b8-405a-b0c8-c64b5effaae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:48 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Volume c4305742-d850-4351-826b-ab4670450a52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4305742-d850-4351-826b-ab4670450a52', 'volume_size': 1} Sep 23 12:47:48 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2010099102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4305742-d850-4351-826b-ab4670450a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c55e88d40c4dd4a504035b48de56f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:47:48Z,use_quota=True,user_id='1af271362d46400b88e9c6cd66d610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Creating volume c4305742-d850-4351-826b-ab4670450a52 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:47:48 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c4305742-d850-4351-826b-ab4670450a52 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD" returned: 0 in 0.667s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:48 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c4305742-d850-4351-826b-ab4670450a52 1073741824 Sep 23 12:47:48 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:48 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD Sep 23 12:47:48 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:48 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558.fc98c089-ddc4-4fdc-bdde-09605fabe865" returned: 0 in 0.445s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] Lock "cinder-quobyte-fc98c089-ddc4-4fdc-bdde-09605fabe865" released by "_delete_snapshot" :: held 2.937s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] Lock "cinder-quobyte-8e3fe179-7d87-41ef-a5de-a5ca32371558" released by "delete_snapshot" :: held 3.081s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] Created reservations ['53a12c26-2639-41c9-8439-e97cde70505e', 'f77c17a0-6ada-426b-8c12-ff1015028a6d', '10f16e97-b390-46e0-b0ab-a7f9f6360927', 'd4931ce2-d2d9-4d0c-9a60-d1c628c313af'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:47:49 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD" returned: 1 in 0.602s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:49 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] Delete snapshot completed successfully. Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c54c10bc-17d2-428a-9413-976dabe06488 tempest-TestStampPattern-1792644428 None] Lock "cinder-fc98c089-ddc4-4fdc-bdde-09605fabe865-delete_snapshot" released by "delete_snapshot" :: held 3.480s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:49 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c4305742-d850-4351-826b-ab4670450a52 1073741824" returned: 0 in 0.787s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c4305742-d850-4351-826b-ab4670450a52 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:49 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c4305742-d850-4351-826b-ab4670450a52 Sep 23 12:47:49 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:49 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c4305742-d850-4351-826b-ab4670450a52" returned: 0 in 0.276s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.482s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac1c7eb-ef77-46ba-b190-d36cc9456645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb4fdf6cae8045b09d70cdc562bed89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:47:46Z,use_quota=True,user_id='fa8580c100594433b9d1ba73b4b7b851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Creating volume fac1c7eb-ef77-46ba-b190-d36cc9456645 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:47:49 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fac1c7eb-ef77-46ba-b190-d36cc9456645 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8efa325-a9b8-405a-b0c8-c64b5effaae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4305742-d850-4351-826b-ab4670450a52', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3e76c1-8255-40ac-909d-f60ef926a95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:49 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fac1c7eb-ef77-46ba-b190-d36cc9456645 1073741824 Sep 23 12:47:49 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:49 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Volume volume-c4305742-d850-4351-826b-ab4670450a52 (c4305742-d850-4351-826b-ab4670450a52): created successfully Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3e76c1-8255-40ac-909d-f60ef926a95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Flow 'volume_create_manager' (ea3d47e5-d664-4981-a859-a417cf975088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:47:49 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-7604ff21-b9a6-4eb9-bb86-7ea74523d393 tempest-VolumesActionsTest-742956622 None] Created volume successfully. Sep 23 12:47:50 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fac1c7eb-ef77-46ba-b190-d36cc9456645 1073741824" returned: 0 in 0.590s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fac1c7eb-ef77-46ba-b190-d36cc9456645 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:50 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fac1c7eb-ef77-46ba-b190-d36cc9456645 Sep 23 12:47:50 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-eb02232f-7ef2-4e51-8468-13ecc466ea5d tempest-VolumesActionsTest-742956622 None] Acquiring lock "cinder-c4305742-d850-4351-826b-ab4670450a52" by "attach_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-eb02232f-7ef2-4e51-8468-13ecc466ea5d tempest-VolumesActionsTest-742956622 None] Lock "cinder-c4305742-d850-4351-826b-ab4670450a52" acquired by "attach_volume" :: waited 0.041s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:50 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-eb02232f-7ef2-4e51-8468-13ecc466ea5d tempest-VolumesActionsTest-742956622 None] Attaching volume c4305742-d850-4351-826b-ab4670450a52 to instance 48e81af0-a3c3-4b64-b245-ccbe9c9a6ee4 at mountpoint /dev/vdb on host None. Sep 23 12:47:50 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-eb02232f-7ef2-4e51-8468-13ecc466ea5d tempest-VolumesActionsTest-742956622 None] Attach volume completed successfully. Sep 23 12:47:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-eb02232f-7ef2-4e51-8468-13ecc466ea5d tempest-VolumesActionsTest-742956622 None] Lock "cinder-c4305742-d850-4351-826b-ab4670450a52" released by "attach_volume" :: held 0.164s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:51 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fac1c7eb-ef77-46ba-b190-d36cc9456645" returned: 0 in 0.716s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:47:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:51 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Attempting download of 406068e6-a060-45a8-812b-825508a2cad0 ((None, [{'url': 'file:///opt/stack/data/glance/images/406068e6-a060-45a8-812b-825508a2cad0', 'metadata': {}}])) to volume fac1c7eb-ef77-46ba-b190-d36cc9456645. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 12:47:51 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8277a8-6fef-42a6-aa7a-57ee882a528b]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_406068e6-a060-45a8-812b-825508a2cad0_fyi84brb {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:51 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_406068e6-a060-45a8-812b-825508a2cad0_fyi84brb Sep 23 12:47:51 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:51 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_406068e6-a060-45a8-812b-825508a2cad0_fyi84brb" returned: 0 in 0.621s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_406068e6-a060-45a8-812b-825508a2cad0_fyi84brb {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:52 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0bafebb4-5ed7-436f-8eb5-1ecbd016300b tempest-VolumesActionsTest-1597267993 None] Terminate volume connection completed successfully. Sep 23 12:47:52 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_406068e6-a060-45a8-812b-825508a2cad0_fyi84brb Sep 23 12:47:52 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0bafebb4-5ed7-436f-8eb5-1ecbd016300b tempest-VolumesActionsTest-1597267993 None] Acquiring lock "cinder-c4305742-d850-4351-826b-ab4670450a52-detach_volume" by "detach_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0bafebb4-5ed7-436f-8eb5-1ecbd016300b tempest-VolumesActionsTest-1597267993 None] Lock "cinder-c4305742-d850-4351-826b-ab4670450a52-detach_volume" acquired by "detach_volume" :: waited 0.077s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:52 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0bafebb4-5ed7-436f-8eb5-1ecbd016300b tempest-VolumesActionsTest-1597267993 None] Detaching volume c4305742-d850-4351-826b-ab4670450a52 from instance 48e81af0-a3c3-4b64-b245-ccbe9c9a6ee4. Sep 23 12:47:52 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0bafebb4-5ed7-436f-8eb5-1ecbd016300b tempest-VolumesActionsTest-1597267993 None] Detach volume completed successfully. Sep 23 12:47:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0bafebb4-5ed7-436f-8eb5-1ecbd016300b tempest-VolumesActionsTest-1597267993 None] Lock "cinder-c4305742-d850-4351-826b-ab4670450a52-detach_volume" released by "detach_volume" :: held 0.135s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:52 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_406068e6-a060-45a8-812b-825508a2cad0_fyi84brb" returned: 1 in 0.958s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_406068e6-a060-45a8-812b-825508a2cad0_fyi84brb' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:47:52 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba0fb64-39f8-4842-af61-0fb05b7de44d]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:53 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD Sep 23 12:47:53 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0ca92c07-274c-4826-8f8d-f56f7e532a1f tempest-VolumesActionsTest-742956622 None] Acquiring lock "cinder-c4305742-d850-4351-826b-ab4670450a52-detach_volume" by "detach_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0ca92c07-274c-4826-8f8d-f56f7e532a1f tempest-VolumesActionsTest-742956622 None] Lock "cinder-c4305742-d850-4351-826b-ab4670450a52-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:53 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0ca92c07-274c-4826-8f8d-f56f7e532a1f tempest-VolumesActionsTest-742956622 None] Volume detach called, but volume not attached. Sep 23 12:47:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0ca92c07-274c-4826-8f8d-f56f7e532a1f tempest-VolumesActionsTest-742956622 None] Lock "cinder-c4305742-d850-4351-826b-ab4670450a52-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:53 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD" returned: 0 in 0.779s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] Acquiring lock "cinder-c4305742-d850-4351-826b-ab4670450a52-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] Lock "cinder-c4305742-d850-4351-826b-ab4670450a52-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:53 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD Sep 23 12:47:53 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] Acquiring lock "cinder-quobyte-c4305742-d850-4351-826b-ab4670450a52" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] Lock "cinder-quobyte-c4305742-d850-4351-826b-ab4670450a52" acquired by "delete_volume" :: waited 0.034s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:54 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88927c0-54b2-4972-9194-419ef4b041f3]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c4305742-d850-4351-826b-ab4670450a52 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:54 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c4305742-d850-4351-826b-ab4670450a52 Sep 23 12:47:54 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:54 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD" returned: 1 in 0.622s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:47:54 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] 406068e6-a060-45a8-812b-825508a2cad0 was raw, converting to qcow2 {{(pid=86085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 12:47:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fac1c7eb-ef77-46ba-b190-d36cc9456645 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:54 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fac1c7eb-ef77-46ba-b190-d36cc9456645 Sep 23 12:47:54 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:54 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c4305742-d850-4351-826b-ab4670450a52" returned: 0 in 0.611s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c4305742-d850-4351-826b-ab4670450a52 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:54 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c4305742-d850-4351-826b-ab4670450a52 Sep 23 12:47:54 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:55 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-c4305742-d850-4351-826b-ab4670450a52" returned: 0 in 0.649s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:55 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] Lock "cinder-quobyte-c4305742-d850-4351-826b-ab4670450a52" released by "delete_volume" :: held 1.374s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:55 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] Created reservations ['062a4832-8dab-4317-be58-9559c5fd17b2', '2331dad1-58a5-4613-8c1a-2f6e6f8cfde0', '6dddb07e-72c1-45ce-a43c-772c6fd32e94', 'a60ca20b-14f5-4aa5-9a6c-3813f5386ee0'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:47:55 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fac1c7eb-ef77-46ba-b190-d36cc9456645" returned: 0 in 1.104s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:55 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_406068e6-a060-45a8-812b-825508a2cad0_afa6ankmdevstack@QuobyteHD, size 0.00 MB, duration 1.11 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fac1c7eb-ef77-46ba-b190-d36cc9456645 {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:47:55 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 12:47:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fac1c7eb-ef77-46ba-b190-d36cc9456645 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:55 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fac1c7eb-ef77-46ba-b190-d36cc9456645 1G Sep 23 12:47:55 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:55 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:47:55 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:55 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fac1c7eb-ef77-46ba-b190-d36cc9456645 1G" returned: 0 in 0.561s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:55 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Downloaded image 406068e6-a060-45a8-812b-825508a2cad0 ((None, [{'url': 'file:///opt/stack/data/glance/images/406068e6-a060-45a8-812b-825508a2cad0', 'metadata': {}}])) to volume fac1c7eb-ef77-46ba-b190-d36cc9456645 successfully. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 12:47:55 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Temporary image 406068e6-a060-45a8-812b-825508a2cad0 for user fa8580c100594433b9d1ba73b4b7b851 is deleted. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 12:47:55 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Marking volume fac1c7eb-ef77-46ba-b190-d36cc9456645 as bootable. {{(pid=86085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 12:47:56 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.444s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:56 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:47:56 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] Deleted volume successfully. Sep 23 12:47:56 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Copying metadata from image 406068e6-a060-45a8-812b-825508a2cad0 to fac1c7eb-ef77-46ba-b190-d36cc9456645. {{(pid=86085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 12:47:56 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Creating volume glance metadata for volume fac1c7eb-ef77-46ba-b190-d36cc9456645 backed by image 406068e6-a060-45a8-812b-825508a2cad0 with: {'image_id': '406068e6-a060-45a8-812b-825508a2cad0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e6a47b2a7fe20c4365d6df6066a9385d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 12:47:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c8f8717a-b6a4-4355-8a39-719b3de609ed tempest-VolumesActionsTest-742956622 None] Lock "cinder-c4305742-d850-4351-826b-ab4670450a52-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] Acquiring lock "cinder-8e3fe179-7d87-41ef-a5de-a5ca32371558-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df529968-2d80-4fa2-90e3-38b312a9fe03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac1c7eb-ef77-46ba-b190-d36cc9456645', 'volume_size': 1, 'image_id': '406068e6-a060-45a8-812b-825508a2cad0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/406068e6-a060-45a8-812b-825508a2cad0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e6a47b2a7fe20c4365d6df6066a9385d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eb4fdf6cae8045b09d70cdc562bed89a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '740540eca1778c0293be9d97908d6ddfe99eeb0c13377411116fca6a07d3d4b4c2aabb30ab7679a1923a10e6fcf9c12c920d028780eb8f3216c51b5f50a80b89', 'id': '406068e6-a060-45a8-812b-825508a2cad0', 'created_at': datetime.datetime(2026, 9, 23, 10, 47, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 47, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/406068e6-a060-45a8-812b-825508a2cad0/file', 'properties': {}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf588288-69ed-4b2f-b44d-9db87d1bce39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:47:56 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Volume volume-fac1c7eb-ef77-46ba-b190-d36cc9456645 (fac1c7eb-ef77-46ba-b190-d36cc9456645): created successfully Sep 23 12:47:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf588288-69ed-4b2f-b44d-9db87d1bce39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:47:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Flow 'volume_create_manager' (222862c4-27ac-4686-9c07-2ed670f816ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:47:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] Lock "cinder-8e3fe179-7d87-41ef-a5de-a5ca32371558-delete_volume" acquired by "delete_volume" :: waited 0.138s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:56 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-9674100d-fadd-4f67-9a0d-a0c1fc057f39 tempest-VolumeImageDependencyTests-176255364 None] Created volume successfully. Sep 23 12:47:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] Acquiring lock "cinder-quobyte-8e3fe179-7d87-41ef-a5de-a5ca32371558" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] Lock "cinder-quobyte-8e3fe179-7d87-41ef-a5de-a5ca32371558" acquired by "delete_volume" :: waited 0.043s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:56 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00d6678-f735-44b8-b081-f99a379c19fd]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:56 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 Sep 23 12:47:56 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] Acquiring lock "cinder-fac1c7eb-ef77-46ba-b190-d36cc9456645-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] Lock "cinder-fac1c7eb-ef77-46ba-b190-d36cc9456645-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] Acquiring lock "cinder-quobyte-fac1c7eb-ef77-46ba-b190-d36cc9456645" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:47:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] Lock "cinder-quobyte-fac1c7eb-ef77-46ba-b190-d36cc9456645" acquired by "delete_volume" :: waited 0.062s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:47:57 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558" returned: 0 in 0.766s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:57 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[12caa24c-1909-4224-ab6c-d8a13ff9faef]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:47:57 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558 Sep 23 12:47:57 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fac1c7eb-ef77-46ba-b190-d36cc9456645 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:57 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fac1c7eb-ef77-46ba-b190-d36cc9456645 Sep 23 12:47:57 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:57 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8e3fe179-7d87-41ef-a5de-a5ca32371558" returned: 0 in 0.572s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] Lock "cinder-quobyte-8e3fe179-7d87-41ef-a5de-a5ca32371558" released by "delete_volume" :: held 1.472s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:57 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-d0a6f86a-8da4-4f98-ba6b-94ab450c41fc req-baf47730-c142-466a-bb40-0510837650bd tempest-TestShelveInstance-635120961 None] Terminate volume connection completed successfully. Sep 23 12:47:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-d0a6f86a-8da4-4f98-ba6b-94ab450c41fc req-baf47730-c142-466a-bb40-0510837650bd tempest-TestShelveInstance-635120961 None] Deleting attachment faf45f38-b885-4fe8-9a12-5e315ba20573. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] Created reservations ['44de6b6a-3aae-44f9-be1c-406297aa89d4', '9e79f937-2049-4f57-8976-840a2162cc99', 'db91f724-0141-4807-8149-621fa40e69c4', 'b1e02d45-07c3-46e8-ae6d-9d3c64c25bad'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:47:58 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fac1c7eb-ef77-46ba-b190-d36cc9456645" returned: 0 in 0.721s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fac1c7eb-ef77-46ba-b190-d36cc9456645 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:58 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fac1c7eb-ef77-46ba-b190-d36cc9456645 Sep 23 12:47:58 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:58 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:47:58 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:58 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fac1c7eb-ef77-46ba-b190-d36cc9456645" returned: 0 in 0.449s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] Lock "cinder-quobyte-fac1c7eb-ef77-46ba-b190-d36cc9456645" released by "delete_volume" :: held 1.382s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:58 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.383s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:47:58 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] Deleted volume successfully. Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3305e3d9-c411-4a85-a9c3-b6a6e179a993 tempest-TestStampPattern-1792644428 None] Lock "cinder-8e3fe179-7d87-41ef-a5de-a5ca32371558-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] Created reservations ['043d05e0-7895-48c8-84c7-158b18e275f1', '6af27d87-ab7d-4f92-afa7-744804dcb156', '1272aa71-9479-426c-93c1-27be2c511374', '99c626dd-5f10-47c7-9d9e-ae206dc2ce9b'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:47:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:47:58 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:47:58 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:47:59 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Sep 23 12:47:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.495s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:47:59 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:47:59 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] Deleted volume successfully. Sep 23 12:47:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-66f10507-3f69-4da3-a1ab-0c4671d8e427 tempest-VolumeImageDependencyTests-176255364 None] Lock "cinder-fac1c7eb-ef77-46ba-b190-d36cc9456645-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Flow 'volume_create_manager' (5c0bbc96-55f5-4c06-a560-2fcba57bcf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf9fca2-db3b-4ed1-8e14-7e9433e63390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf9fca2-db3b-4ed1-8e14-7e9433e63390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1189122379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf3b224-cb54-4e4a-9486-877b5986ae87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c55e88d40c4dd4a504035b48de56f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:02Z,use_quota=True,user_id='1af271362d46400b88e9c6cd66d610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c686df5c-d098-4c5c-867e-2267bef9f650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c686df5c-d098-4c5c-867e-2267bef9f650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a5404db-8d9f-49d0-8227-e093382081a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a5404db-8d9f-49d0-8227-e093382081a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bf3b224-cb54-4e4a-9486-877b5986ae87', 'volume_name': 'volume-6bf3b224-cb54-4e4a-9486-877b5986ae87', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089daa3f-f1ae-4d0e-b87a-547de3ffbd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089daa3f-f1ae-4d0e-b87a-547de3ffbd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3aee1d-eacb-42c8-bf2a-53517fb3df1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:01 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Volume 6bf3b224-cb54-4e4a-9486-877b5986ae87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bf3b224-cb54-4e4a-9486-877b5986ae87', 'volume_size': 1} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1189122379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf3b224-cb54-4e4a-9486-877b5986ae87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c55e88d40c4dd4a504035b48de56f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:02Z,use_quota=True,user_id='1af271362d46400b88e9c6cd66d610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Creating volume 6bf3b224-cb54-4e4a-9486-877b5986ae87 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:48:01 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:48:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6bf3b224-cb54-4e4a-9486-877b5986ae87 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:01 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6bf3b224-cb54-4e4a-9486-877b5986ae87 1073741824 Sep 23 12:48:01 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:02 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6bf3b224-cb54-4e4a-9486-877b5986ae87 1073741824" returned: 0 in 0.634s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6bf3b224-cb54-4e4a-9486-877b5986ae87 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:02 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6bf3b224-cb54-4e4a-9486-877b5986ae87 Sep 23 12:48:02 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-6e01f476-8726-424f-a6d5-c93b37a56d90 req-ad4af728-a1f1-4905-9c39-991bf81f0f4e tempest-TestShelveInstance-635120961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:03 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6bf3b224-cb54-4e4a-9486-877b5986ae87" returned: 0 in 0.444s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:48:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-6e01f476-8726-424f-a6d5-c93b37a56d90 req-ad4af728-a1f1-4905-9c39-991bf81f0f4e tempest-TestShelveInstance-635120961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.036s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3aee1d-eacb-42c8-bf2a-53517fb3df1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bf3b224-cb54-4e4a-9486-877b5986ae87', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a65aaa-28f5-4bf3-8094-722d5e328019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-6e01f476-8726-424f-a6d5-c93b37a56d90 req-ad4af728-a1f1-4905-9c39-991bf81f0f4e tempest-TestShelveInstance-635120961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:03 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Volume volume-6bf3b224-cb54-4e4a-9486-877b5986ae87 (6bf3b224-cb54-4e4a-9486-877b5986ae87): created successfully Sep 23 12:48:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a65aaa-28f5-4bf3-8094-722d5e328019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Flow 'volume_create_manager' (5c0bbc96-55f5-4c06-a560-2fcba57bcf2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:03 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-c39d2921-3b59-4300-9e98-dfe41a16146a tempest-VolumesActionsTest-742956622 None] Created volume successfully. Sep 23 12:48:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-6e01f476-8726-424f-a6d5-c93b37a56d90 req-ad4af728-a1f1-4905-9c39-991bf81f0f4e tempest-TestShelveInstance-635120961 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29b38f50-89dc-4b7d-8bdf-c4aaa304a618', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:48:03 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-6e01f476-8726-424f-a6d5-c93b37a56d90 req-ad4af728-a1f1-4905-9c39-991bf81f0f4e tempest-TestShelveInstance-635120961 None] attachment_update completed successfully. Sep 23 12:48:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] Acquiring lock "cinder-6bf3b224-cb54-4e4a-9486-877b5986ae87-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] Lock "cinder-6bf3b224-cb54-4e4a-9486-877b5986ae87-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] Acquiring lock "cinder-quobyte-6bf3b224-cb54-4e4a-9486-877b5986ae87" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] Lock "cinder-quobyte-6bf3b224-cb54-4e4a-9486-877b5986ae87" acquired by "delete_volume" :: waited 0.028s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:04 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[85591ba3-c887-4a60-8f30-4ea0da1cbd7d]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6bf3b224-cb54-4e4a-9486-877b5986ae87 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:04 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6bf3b224-cb54-4e4a-9486-877b5986ae87 Sep 23 12:48:04 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:04 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6bf3b224-cb54-4e4a-9486-877b5986ae87" returned: 0 in 0.483s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6bf3b224-cb54-4e4a-9486-877b5986ae87 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:04 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6bf3b224-cb54-4e4a-9486-877b5986ae87 Sep 23 12:48:04 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Flow 'volume_create_manager' (408b421c-29fd-4c2c-8f12-f7de9eda2db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee472da-a5c1-4f8b-bd79-c9348421d6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee472da-a5c1-4f8b-bd79-c9348421d6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-909872836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0116b2b3-d6e6-461d-9db8-86cf83d87250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24de3b6f509499b9a57e8f64e9b5e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:05Z,use_quota=True,user_id='73e73958b4564e05b02ab030479afec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:05 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec51bf50-7718-4b0e-bc54-35b11efdc5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec51bf50-7718-4b0e-bc54-35b11efdc5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c5fe25-c6a7-4b3f-a565-cff8d82b9b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c5fe25-c6a7-4b3f-a565-cff8d82b9b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0116b2b3-d6e6-461d-9db8-86cf83d87250', 'volume_name': 'volume-0116b2b3-d6e6-461d-9db8-86cf83d87250', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736c5547-1e81-4628-bc0f-037250a32f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736c5547-1e81-4628-bc0f-037250a32f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92df2f4-8fe4-440e-b7e7-18634bd117e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:05 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Volume 0116b2b3-d6e6-461d-9db8-86cf83d87250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0116b2b3-d6e6-461d-9db8-86cf83d87250', 'volume_size': 1} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-909872836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0116b2b3-d6e6-461d-9db8-86cf83d87250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24de3b6f509499b9a57e8f64e9b5e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:05Z,use_quota=True,user_id='73e73958b4564e05b02ab030479afec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Creating volume 0116b2b3-d6e6-461d-9db8-86cf83d87250 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:48:05 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0116b2b3-d6e6-461d-9db8-86cf83d87250 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6bf3b224-cb54-4e4a-9486-877b5986ae87" returned: 0 in 0.447s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:05 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0116b2b3-d6e6-461d-9db8-86cf83d87250 1073741824 Sep 23 12:48:05 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] Lock "cinder-quobyte-6bf3b224-cb54-4e4a-9486-877b5986ae87" released by "delete_volume" :: held 1.036s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] Created reservations ['e96e0d19-dd3d-4bc4-bb29-727ffa2d98c8', 'bb3075d4-8c11-40cb-8375-9cf7d81fa063', '24d1e86b-c6b0-4531-8a22-27a0c24298f1', '519a1a54-570c-47ce-8d2f-7b2892538982'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:05 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:48:05 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:05 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0116b2b3-d6e6-461d-9db8-86cf83d87250 1073741824" returned: 0 in 0.622s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:05 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.394s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:48:05 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] Deleted volume successfully. Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0116b2b3-d6e6-461d-9db8-86cf83d87250 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:05 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7a0163ae-75c3-4261-a8cb-3774cb4202d7 tempest-VolumesActionsTest-1597267993 None] Lock "cinder-6bf3b224-cb54-4e4a-9486-877b5986ae87-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:05 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0116b2b3-d6e6-461d-9db8-86cf83d87250 Sep 23 12:48:05 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:06 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0116b2b3-d6e6-461d-9db8-86cf83d87250" returned: 0 in 0.331s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:06 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:48:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92df2f4-8fe4-440e-b7e7-18634bd117e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0116b2b3-d6e6-461d-9db8-86cf83d87250', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac6f2ae-fb58-4e02-8148-bd2e2f67f122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:06 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Volume volume-0116b2b3-d6e6-461d-9db8-86cf83d87250 (0116b2b3-d6e6-461d-9db8-86cf83d87250): created successfully Sep 23 12:48:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac6f2ae-fb58-4e02-8148-bd2e2f67f122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:06 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Flow 'volume_create_manager' (408b421c-29fd-4c2c-8f12-f7de9eda2db5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:06 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ac3d07e7-aae0-49c3-8c2b-15e47b380684 tempest-ProjectReaderTests-1496657168 None] Created volume successfully. Sep 23 12:48:07 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:48:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Flow 'volume_create_manager' (09597c7e-2cc3-4081-97cd-b102e4a1b7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe30a26-aab2-4018-b993-117bf25fa537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe30a26-aab2-4018-b993-117bf25fa537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-606925867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255863ea-b09d-4970-9841-dc1072a6b233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c55e88d40c4dd4a504035b48de56f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:08Z,use_quota=True,user_id='1af271362d46400b88e9c6cd66d610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be74beb3-860c-410c-9697-71ab743e3397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be74beb3-860c-410c-9697-71ab743e3397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1709019e-b22e-446d-9f1f-f9bcd7b99b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1709019e-b22e-446d-9f1f-f9bcd7b99b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '255863ea-b09d-4970-9841-dc1072a6b233', 'volume_name': 'volume-255863ea-b09d-4970-9841-dc1072a6b233', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b4de56-f562-4fab-9c39-ccff0d2af510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b4de56-f562-4fab-9c39-ccff0d2af510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cf5359-cd75-4653-8324-1bdfaad281d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:07 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Volume 255863ea-b09d-4970-9841-dc1072a6b233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-255863ea-b09d-4970-9841-dc1072a6b233', 'volume_size': 1} Sep 23 12:48:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-606925867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255863ea-b09d-4970-9841-dc1072a6b233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c55e88d40c4dd4a504035b48de56f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:08Z,use_quota=True,user_id='1af271362d46400b88e9c6cd66d610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:48:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Creating volume 255863ea-b09d-4970-9841-dc1072a6b233 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:48:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:08 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:08 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:48:08 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:48:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-255863ea-b09d-4970-9841-dc1072a6b233 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:08 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] Acquiring lock "cinder-0116b2b3-d6e6-461d-9db8-86cf83d87250-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:08 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] Lock "cinder-0116b2b3-d6e6-461d-9db8-86cf83d87250-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:08 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-255863ea-b09d-4970-9841-dc1072a6b233 1073741824 Sep 23 12:48:08 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:08 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] Acquiring lock "cinder-quobyte-0116b2b3-d6e6-461d-9db8-86cf83d87250" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:08 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] Lock "cinder-quobyte-0116b2b3-d6e6-461d-9db8-86cf83d87250" acquired by "delete_volume" :: waited 0.035s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:08 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bd9c20-297a-426b-970b-57ac67dcf6b0]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0116b2b3-d6e6-461d-9db8-86cf83d87250 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:08 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0116b2b3-d6e6-461d-9db8-86cf83d87250 Sep 23 12:48:08 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:08 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-255863ea-b09d-4970-9841-dc1072a6b233 1073741824" returned: 0 in 0.848s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:08 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0116b2b3-d6e6-461d-9db8-86cf83d87250" returned: 0 in 0.640s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0116b2b3-d6e6-461d-9db8-86cf83d87250 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-255863ea-b09d-4970-9841-dc1072a6b233 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:08 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0116b2b3-d6e6-461d-9db8-86cf83d87250 Sep 23 12:48:08 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:08 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-255863ea-b09d-4970-9841-dc1072a6b233 Sep 23 12:48:08 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:09 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-255863ea-b09d-4970-9841-dc1072a6b233" returned: 0 in 0.407s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:09 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:48:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:09 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cf5359-cd75-4653-8324-1bdfaad281d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-255863ea-b09d-4970-9841-dc1072a6b233', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:09 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1946e4e-bb50-49b3-b345-8dbb816bc497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:09 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0116b2b3-d6e6-461d-9db8-86cf83d87250" returned: 0 in 0.454s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:09 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Volume volume-255863ea-b09d-4970-9841-dc1072a6b233 (255863ea-b09d-4970-9841-dc1072a6b233): created successfully Sep 23 12:48:09 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1946e4e-bb50-49b3-b345-8dbb816bc497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:09 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Flow 'volume_create_manager' (09597c7e-2cc3-4081-97cd-b102e4a1b7fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] Lock "cinder-quobyte-0116b2b3-d6e6-461d-9db8-86cf83d87250" released by "delete_volume" :: held 1.199s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:09 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0b32ef40-9a5b-418e-b9a7-f66c8588c818 tempest-VolumesActionsTest-742956622 None] Created volume successfully. Sep 23 12:48:09 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] Created reservations ['b87b18e0-be38-4a5d-9d06-511eafff2e83', '34d6c77c-b137-40fd-8c01-4ed3c1d55246', '7fed89b9-ab66-496a-8c03-e06de7a441b0', 'de815582-5214-428b-b4e2-fc77e48c947e'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:48:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:09 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:09 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:09 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:48:09 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] Acquiring lock "cinder-255863ea-b09d-4970-9841-dc1072a6b233-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] Lock "cinder-255863ea-b09d-4970-9841-dc1072a6b233-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:10 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.386s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:10 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:48:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] Acquiring lock "cinder-quobyte-255863ea-b09d-4970-9841-dc1072a6b233" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:10 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] Deleted volume successfully. Sep 23 12:48:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] Lock "cinder-quobyte-255863ea-b09d-4970-9841-dc1072a6b233" acquired by "delete_volume" :: waited 0.026s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-50ecd481-c184-4297-8bc4-daeff014b050 tempest-ProjectReaderTests-1496657168 None] Lock "cinder-0116b2b3-d6e6-461d-9db8-86cf83d87250-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:10 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2b53dd-24d6-467a-9ae0-6380c385064a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-255863ea-b09d-4970-9841-dc1072a6b233 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:10 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-255863ea-b09d-4970-9841-dc1072a6b233 Sep 23 12:48:10 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:10 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-255863ea-b09d-4970-9841-dc1072a6b233" returned: 0 in 0.746s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-255863ea-b09d-4970-9841-dc1072a6b233 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:11 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-255863ea-b09d-4970-9841-dc1072a6b233 Sep 23 12:48:11 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Flow 'volume_create_manager' (4ce9ce73-296c-4248-b730-50a1a4cd6310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c9f8b8-c2f3-4353-b870-4ed249e408b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c9f8b8-c2f3-4353-b870-4ed249e408b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1956016038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0cccfc-1a61-4932-a89a-0946902791b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24de3b6f509499b9a57e8f64e9b5e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:11Z,use_quota=True,user_id='73e73958b4564e05b02ab030479afec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54f96e0-6001-48af-b51f-1db9f908fbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54f96e0-6001-48af-b51f-1db9f908fbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81da9d8d-070e-419e-b872-713a21da5ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81da9d8d-070e-419e-b872-713a21da5ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee0cccfc-1a61-4932-a89a-0946902791b0', 'volume_name': 'volume-ee0cccfc-1a61-4932-a89a-0946902791b0', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccfc84a2-bf4a-4ea9-a2aa-387cc0ebd485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccfc84a2-bf4a-4ea9-a2aa-387cc0ebd485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1559888-cc7a-4ab4-83a7-cfd2a08eaf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:11 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Volume ee0cccfc-1a61-4932-a89a-0946902791b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee0cccfc-1a61-4932-a89a-0946902791b0', 'volume_size': 1} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1956016038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0cccfc-1a61-4932-a89a-0946902791b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24de3b6f509499b9a57e8f64e9b5e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:11Z,use_quota=True,user_id='73e73958b4564e05b02ab030479afec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Creating volume ee0cccfc-1a61-4932-a89a-0946902791b0 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:48:11 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ee0cccfc-1a61-4932-a89a-0946902791b0 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:11 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-255863ea-b09d-4970-9841-dc1072a6b233" returned: 0 in 0.387s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:11 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ee0cccfc-1a61-4932-a89a-0946902791b0 1073741824 Sep 23 12:48:11 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] Lock "cinder-quobyte-255863ea-b09d-4970-9841-dc1072a6b233" released by "delete_volume" :: held 1.215s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] Created reservations ['dcfe746c-352b-48f9-b7d7-b5c99952f02c', '2c03b255-7601-4100-89d5-01d5ce270e69', '654a1ec7-5a45-4c1c-99bb-3eee7bdfc216', '4b41a70f-8d96-42a1-8494-1a63b71cf5f8'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:11 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:48:11 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:11 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.354s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:48:11 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] Deleted volume successfully. Sep 23 12:48:11 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ee0cccfc-1a61-4932-a89a-0946902791b0 1073741824" returned: 0 in 0.604s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ec94b93a-93a9-4bda-bc7d-cecd8d8cce00 tempest-VolumesActionsTest-1597267993 None] Lock "cinder-255863ea-b09d-4970-9841-dc1072a6b233-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ee0cccfc-1a61-4932-a89a-0946902791b0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:12 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ee0cccfc-1a61-4932-a89a-0946902791b0 Sep 23 12:48:12 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:12 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ee0cccfc-1a61-4932-a89a-0946902791b0" returned: 0 in 0.534s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:48:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1559888-cc7a-4ab4-83a7-cfd2a08eaf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0cccfc-1a61-4932-a89a-0946902791b0', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ceaa181-b185-460e-bb9d-01e767db7520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:12 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Volume volume-ee0cccfc-1a61-4932-a89a-0946902791b0 (ee0cccfc-1a61-4932-a89a-0946902791b0): created successfully Sep 23 12:48:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ceaa181-b185-460e-bb9d-01e767db7520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Flow 'volume_create_manager' (4ce9ce73-296c-4248-b730-50a1a4cd6310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:12 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-5b8785af-17aa-4572-864c-8ad4d7bb73ef tempest-ProjectReaderTests-1496657168 None] Created volume successfully. Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] Acquiring lock "cinder-ee0cccfc-1a61-4932-a89a-0946902791b0-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] Lock "cinder-ee0cccfc-1a61-4932-a89a-0946902791b0-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Flow 'volume_create_manager' (2323d1e3-ff51-4056-a3af-4a38235aa851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2797a9da-f5fc-476b-90b1-d08a8613cd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2797a9da-f5fc-476b-90b1-d08a8613cd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1038008568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c6106e-0d86-49d8-af8f-d9b785ee7697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c55e88d40c4dd4a504035b48de56f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:13Z,use_quota=True,user_id='1af271362d46400b88e9c6cd66d610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a094d4-fb2a-4a1c-adb6-47295a55fc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a094d4-fb2a-4a1c-adb6-47295a55fc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df659d47-94a5-42bb-9274-20642626755f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df659d47-94a5-42bb-9274-20642626755f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54c6106e-0d86-49d8-af8f-d9b785ee7697', 'volume_name': 'volume-54c6106e-0d86-49d8-af8f-d9b785ee7697', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c82550-4c26-4bdf-841d-ec371db8cd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c82550-4c26-4bdf-841d-ec371db8cd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aeb2b77-4579-4880-b4d1-3b33b45c44c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:13 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Volume 54c6106e-0d86-49d8-af8f-d9b785ee7697: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54c6106e-0d86-49d8-af8f-d9b785ee7697', 'volume_size': 1} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1038008568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c6106e-0d86-49d8-af8f-d9b785ee7697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c55e88d40c4dd4a504035b48de56f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:13Z,use_quota=True,user_id='1af271362d46400b88e9c6cd66d610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Creating volume 54c6106e-0d86-49d8-af8f-d9b785ee7697 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:48:13 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-54c6106e-0d86-49d8-af8f-d9b785ee7697 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] Acquiring lock "cinder-quobyte-ee0cccfc-1a61-4932-a89a-0946902791b0" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:13 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-54c6106e-0d86-49d8-af8f-d9b785ee7697 1073741824 Sep 23 12:48:13 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] Lock "cinder-quobyte-ee0cccfc-1a61-4932-a89a-0946902791b0" acquired by "delete_volume" :: waited 0.030s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d196d1-0421-4ba7-89a5-d003ef366be8]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ee0cccfc-1a61-4932-a89a-0946902791b0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:13 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ee0cccfc-1a61-4932-a89a-0946902791b0 Sep 23 12:48:13 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:14 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ee0cccfc-1a61-4932-a89a-0946902791b0" returned: 0 in 0.619s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ee0cccfc-1a61-4932-a89a-0946902791b0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:14 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-54c6106e-0d86-49d8-af8f-d9b785ee7697 1073741824" returned: 0 in 0.776s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:14 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ee0cccfc-1a61-4932-a89a-0946902791b0 Sep 23 12:48:14 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-54c6106e-0d86-49d8-af8f-d9b785ee7697 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:14 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-54c6106e-0d86-49d8-af8f-d9b785ee7697 Sep 23 12:48:14 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:14 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ee0cccfc-1a61-4932-a89a-0946902791b0" returned: 0 in 0.422s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] Lock "cinder-quobyte-ee0cccfc-1a61-4932-a89a-0946902791b0" released by "delete_volume" :: held 1.124s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:INSERT=42,cinder:SELECT=139,cinder:UPDATE=159,cinder:DELETE=15 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:48:14 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-54c6106e-0d86-49d8-af8f-d9b785ee7697" returned: 0 in 0.457s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] Created reservations ['38ba20c0-a2a1-4ef6-85fa-53834feba721', 'f46ea49c-efb8-45a8-87fa-97137d2db5de', 'c35eee8b-b429-4e82-8cb9-225257cfa6a3', '10b14d9a-d2b7-44a8-ab7e-70b39d1f132f'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aeb2b77-4579-4880-b4d1-3b33b45c44c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54c6106e-0d86-49d8-af8f-d9b785ee7697', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a346f72-9060-45da-b6b6-8cd10692de5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:14 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Volume volume-54c6106e-0d86-49d8-af8f-d9b785ee7697 (54c6106e-0d86-49d8-af8f-d9b785ee7697): created successfully Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a346f72-9060-45da-b6b6-8cd10692de5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Flow 'volume_create_manager' (2323d1e3-ff51-4056-a3af-4a38235aa851) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:14 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-cb2b4cf8-f4a6-4b9b-9223-42c48ca03764 tempest-VolumesActionsTest-742956622 None] Created volume successfully. Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:15 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:48:15 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:15 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.323s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:15 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:48:15 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] Deleted volume successfully. Sep 23 12:48:15 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8d69aa22-edb8-477b-b653-80eb3549b69d tempest-ProjectReaderTests-1496657168 None] Lock "cinder-ee0cccfc-1a61-4932-a89a-0946902791b0-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:15 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] Acquiring lock "cinder-54c6106e-0d86-49d8-af8f-d9b785ee7697-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:15 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] Lock "cinder-54c6106e-0d86-49d8-af8f-d9b785ee7697-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:15 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=127,cinder:INSERT=41,cinder:UPDATE=157,cinder:DELETE=9 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:48:15 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] Acquiring lock "cinder-quobyte-54c6106e-0d86-49d8-af8f-d9b785ee7697" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:15 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] Lock "cinder-quobyte-54c6106e-0d86-49d8-af8f-d9b785ee7697" acquired by "delete_volume" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:15 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63d1419-4dd4-40d1-927a-8eead59075ce]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-54c6106e-0d86-49d8-af8f-d9b785ee7697 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:16 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-54c6106e-0d86-49d8-af8f-d9b785ee7697 Sep 23 12:48:16 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:16 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Flow 'volume_create_manager' (e6cbc1b7-709f-4c53-afa6-65cee138ef3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c625d1e-0a44-47d4-8bbf-04e1c1ea295f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-54c6106e-0d86-49d8-af8f-d9b785ee7697" returned: 0 in 0.691s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-54c6106e-0d86-49d8-af8f-d9b785ee7697 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c625d1e-0a44-47d4-8bbf-04e1c1ea295f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1928044581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b49efb3-f202-4eda-a6aa-4a4f05a565ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24de3b6f509499b9a57e8f64e9b5e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:16Z,use_quota=True,user_id='73e73958b4564e05b02ab030479afec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56ef6b0-c941-40ef-b42d-8ccedddb4497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56ef6b0-c941-40ef-b42d-8ccedddb4497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:16 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-54c6106e-0d86-49d8-af8f-d9b785ee7697 Sep 23 12:48:16 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14851aae-735c-4a32-837d-8d73ef81cc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14851aae-735c-4a32-837d-8d73ef81cc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b49efb3-f202-4eda-a6aa-4a4f05a565ef', 'volume_name': 'volume-9b49efb3-f202-4eda-a6aa-4a4f05a565ef', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee7e52a-74b8-474e-9799-fc37b7600f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee7e52a-74b8-474e-9799-fc37b7600f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04bee82-0706-4462-9c10-445547da54a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:16 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Volume 9b49efb3-f202-4eda-a6aa-4a4f05a565ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b49efb3-f202-4eda-a6aa-4a4f05a565ef', 'volume_size': 1} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1928044581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b49efb3-f202-4eda-a6aa-4a4f05a565ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24de3b6f509499b9a57e8f64e9b5e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:16Z,use_quota=True,user_id='73e73958b4564e05b02ab030479afec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Creating volume 9b49efb3-f202-4eda-a6aa-4a4f05a565ef {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:48:16 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b49efb3-f202-4eda-a6aa-4a4f05a565ef 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:16 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b49efb3-f202-4eda-a6aa-4a4f05a565ef 1073741824 Sep 23 12:48:16 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:16 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-54c6106e-0d86-49d8-af8f-d9b785ee7697" returned: 0 in 0.398s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:16 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] Lock "cinder-quobyte-54c6106e-0d86-49d8-af8f-d9b785ee7697" released by "delete_volume" :: held 1.166s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:17 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] Created reservations ['c491c282-80e6-465e-a319-03b6355e293c', '1d7e18d5-f529-4118-bd67-ab9157a7418b', '2209b79b-67be-4045-bcfb-714820d0981b', 'c72ec021-9af3-4724-9689-83795579baca'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:48:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:17 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:48:17 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:17 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b49efb3-f202-4eda-a6aa-4a4f05a565ef 1073741824" returned: 0 in 0.657s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b49efb3-f202-4eda-a6aa-4a4f05a565ef {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:17 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b49efb3-f202-4eda-a6aa-4a4f05a565ef Sep 23 12:48:17 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:17 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.342s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:17 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:48:17 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] Deleted volume successfully. Sep 23 12:48:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-26519d65-6dd0-4b39-8fd4-dfdd8cd256f9 tempest-VolumesActionsTest-1597267993 None] Lock "cinder-54c6106e-0d86-49d8-af8f-d9b785ee7697-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:17 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b49efb3-f202-4eda-a6aa-4a4f05a565ef" returned: 0 in 0.371s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:48:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04bee82-0706-4462-9c10-445547da54a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b49efb3-f202-4eda-a6aa-4a4f05a565ef', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21730a56-b889-4342-9ac5-3e9ddafe48b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:17 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Volume volume-9b49efb3-f202-4eda-a6aa-4a4f05a565ef (9b49efb3-f202-4eda-a6aa-4a4f05a565ef): created successfully Sep 23 12:48:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21730a56-b889-4342-9ac5-3e9ddafe48b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Flow 'volume_create_manager' (e6cbc1b7-709f-4c53-afa6-65cee138ef3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:17 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-9c0163a1-cee8-42ff-bf24-631b3639717c tempest-ProjectReaderTests-1496657168 None] Created volume successfully. Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Flow 'volume_create_manager' (7615c423-2ad7-44da-afb3-99162874b9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27971026-06bf-46c5-bf0d-4d8d5f64b505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27971026-06bf-46c5-bf0d-4d8d5f64b505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-602704883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2546aa06874f2085d15d6547c392f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:18Z,use_quota=True,user_id='15cae67e320d4967a01395ed9ec36744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac60b428-56a9-41e1-b95c-af7f10cba7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac60b428-56a9-41e1-b95c-af7f10cba7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5909afc-438a-4b1c-bdf2-1960a486bf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5909afc-438a-4b1c-bdf2-1960a486bf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6', 'volume_name': 'volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3974479c-1ea8-4237-b16c-ba9d2554c97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3974479c-1ea8-4237-b16c-ba9d2554c97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff139dd9-1753-40d5-8792-9d7ea993b740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:18 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Volume 3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6', 'volume_size': 1} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-602704883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2546aa06874f2085d15d6547c392f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:18Z,use_quota=True,user_id='15cae67e320d4967a01395ed9ec36744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Creating volume 3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:48:18 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:18 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 1073741824 Sep 23 12:48:18 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Flow 'volume_create_manager' (67c5e250-763f-4a1f-9305-b36d42b6b032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b348f0-5452-442f-a27d-f523807fd773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] Acquiring lock "cinder-9b49efb3-f202-4eda-a6aa-4a4f05a565ef-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b348f0-5452-442f-a27d-f523807fd773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2113323542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabdd834-d007-4788-9c62-a65cf9222329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c55e88d40c4dd4a504035b48de56f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:19Z,use_quota=True,user_id='1af271362d46400b88e9c6cd66d610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a10f23cd-992d-40e6-b118-caffdffc9c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a10f23cd-992d-40e6-b118-caffdffc9c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe3f7fd3-1674-4ee9-9ba0-452e5c1e64c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe3f7fd3-1674-4ee9-9ba0-452e5c1e64c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fabdd834-d007-4788-9c62-a65cf9222329', 'volume_name': 'volume-fabdd834-d007-4788-9c62-a65cf9222329', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:18 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b225bc2d-db62-4368-b40c-a23f7399853f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b225bc2d-db62-4368-b40c-a23f7399853f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d6d93e8-03dc-4302-93a6-45245f45c0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:18 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Volume fabdd834-d007-4788-9c62-a65cf9222329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fabdd834-d007-4788-9c62-a65cf9222329', 'volume_size': 1} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] Lock "cinder-9b49efb3-f202-4eda-a6aa-4a4f05a565ef-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 1073741824" returned: 0 in 0.673s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] Acquiring lock "cinder-quobyte-9b49efb3-f202-4eda-a6aa-4a4f05a565ef" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] Lock "cinder-quobyte-9b49efb3-f202-4eda-a6aa-4a4f05a565ef" acquired by "delete_volume" :: waited 0.032s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:18 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 Sep 23 12:48:18 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ccadfb-e410-438a-af45-8b31e421c092]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b49efb3-f202-4eda-a6aa-4a4f05a565ef {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:19 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b49efb3-f202-4eda-a6aa-4a4f05a565ef Sep 23 12:48:19 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:19 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6" returned: 0 in 0.285s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.354s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2113323542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabdd834-d007-4788-9c62-a65cf9222329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c55e88d40c4dd4a504035b48de56f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:19Z,use_quota=True,user_id='1af271362d46400b88e9c6cd66d610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Creating volume fabdd834-d007-4788-9c62-a65cf9222329 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:48:19 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fabdd834-d007-4788-9c62-a65cf9222329 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff139dd9-1753-40d5-8792-9d7ea993b740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:19 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fabdd834-d007-4788-9c62-a65cf9222329 1073741824 Sep 23 12:48:19 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8854bc0-0647-4a91-aea3-0b43852791b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:19 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Volume volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 (3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6): created successfully Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8854bc0-0647-4a91-aea3-0b43852791b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Flow 'volume_create_manager' (7615c423-2ad7-44da-afb3-99162874b9f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:19 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-2b878b22-36bf-489f-999b-21c7ff01015d tempest-VolumeDependencyTests-2049859779 None] Created volume successfully. Sep 23 12:48:19 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b49efb3-f202-4eda-a6aa-4a4f05a565ef" returned: 0 in 0.432s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b49efb3-f202-4eda-a6aa-4a4f05a565ef {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:19 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b49efb3-f202-4eda-a6aa-4a4f05a565ef Sep 23 12:48:19 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:19 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9b49efb3-f202-4eda-a6aa-4a4f05a565ef" returned: 0 in 0.307s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:19 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] Lock "cinder-quobyte-9b49efb3-f202-4eda-a6aa-4a4f05a565ef" released by "delete_volume" :: held 0.790s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fabdd834-d007-4788-9c62-a65cf9222329 1073741824" returned: 0 in 0.516s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fabdd834-d007-4788-9c62-a65cf9222329 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:19 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fabdd834-d007-4788-9c62-a65cf9222329 Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] Created reservations ['5cc31270-4cb6-4dbe-9231-4fcc97a2b50d', '2b63df40-d703-4c4a-967a-0ed229db6920', 'dcd083a0-46ae-49bd-b97e-66015683c873', '835d55ae-9efe-4da1-bac9-3c1dca8e6324'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:48:19 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:19 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:48:19 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:20 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fabdd834-d007-4788-9c62-a65cf9222329" returned: 0 in 0.304s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d6d93e8-03dc-4302-93a6-45245f45c0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fabdd834-d007-4788-9c62-a65cf9222329', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dbd35da-50dd-42c0-8282-35dde400ddbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:20 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Volume volume-fabdd834-d007-4788-9c62-a65cf9222329 (fabdd834-d007-4788-9c62-a65cf9222329): created successfully Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dbd35da-50dd-42c0-8282-35dde400ddbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Flow 'volume_create_manager' (67c5e250-763f-4a1f-9305-b36d42b6b032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:20 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-26a8ab7d-918d-41f4-9743-846ef40c3c90 tempest-VolumesActionsTest-742956622 None] Created volume successfully. Sep 23 12:48:20 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.284s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:48:20 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] Deleted volume successfully. Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e19dcb48-4626-4412-b767-f19d6632212d tempest-ProjectReaderTests-1496657168 None] Lock "cinder-9b49efb3-f202-4eda-a6aa-4a4f05a565ef-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ac81bcd8-0902-4699-9320-c13e27a437e1 tempest-VolumeDependencyTests-2049859779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ac81bcd8-0902-4699-9320-c13e27a437e1 tempest-VolumeDependencyTests-2049859779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ac81bcd8-0902-4699-9320-c13e27a437e1 tempest-VolumeDependencyTests-2049859779 None] Creating offline snapshot a3ad3df9-d497-4215-8013-a9e09205c507 of volume 3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8b9f09-b2e9-48b3-8e88-3a2b6bd1450f]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac81bcd8-0902-4699-9320-c13e27a437e1 tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:20 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 Sep 23 12:48:20 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] Acquiring lock "cinder-fabdd834-d007-4788-9c62-a65cf9222329-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] Lock "cinder-fabdd834-d007-4788-9c62-a65cf9222329-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:20 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac81bcd8-0902-4699-9320-c13e27a437e1 tempest-VolumeDependencyTests-2049859779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6" returned: 0 in 0.434s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac81bcd8-0902-4699-9320-c13e27a437e1 tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] Acquiring lock "cinder-quobyte-fabdd834-d007-4788-9c62-a65cf9222329" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:20 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507 1G Sep 23 12:48:20 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] Lock "cinder-quobyte-fabdd834-d007-4788-9c62-a65cf9222329" acquired by "delete_volume" :: waited 0.030s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[92238e12-3d60-4f71-a39f-35253f869be0]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fabdd834-d007-4788-9c62-a65cf9222329 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:21 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fabdd834-d007-4788-9c62-a65cf9222329 Sep 23 12:48:21 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:21 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fabdd834-d007-4788-9c62-a65cf9222329" returned: 0 in 0.505s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fabdd834-d007-4788-9c62-a65cf9222329 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:21 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac81bcd8-0902-4699-9320-c13e27a437e1 tempest-VolumeDependencyTests-2049859779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507 1G" returned: 0 in 0.627s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac81bcd8-0902-4699-9320-c13e27a437e1 tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:21 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fabdd834-d007-4788-9c62-a65cf9222329 Sep 23 12:48:21 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:21 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507 Sep 23 12:48:21 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Flow 'volume_create_manager' (62e57a8f-08d2-4b3b-afef-46dde341a623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d622b46-c682-47ad-9228-b27655580209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d622b46-c682-47ad-9228-b27655580209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-87448693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbf4220a-2ce8-4cbd-8057-d36beaa8b879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24de3b6f509499b9a57e8f64e9b5e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:22Z,use_quota=True,user_id='73e73958b4564e05b02ab030479afec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8ad633-9a27-476d-8247-e20517adfff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8ad633-9a27-476d-8247-e20517adfff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b3e072-f8f2-49c9-b1ab-d2f00c22592f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b3e072-f8f2-49c9-b1ab-d2f00c22592f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbf4220a-2ce8-4cbd-8057-d36beaa8b879', 'volume_name': 'volume-bbf4220a-2ce8-4cbd-8057-d36beaa8b879', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8e94d7-235f-4721-adb8-40e43186c7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8e94d7-235f-4721-adb8-40e43186c7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22938a98-a7e7-4f98-b52c-a266d090da32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:21 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Volume bbf4220a-2ce8-4cbd-8057-d36beaa8b879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbf4220a-2ce8-4cbd-8057-d36beaa8b879', 'volume_size': 1} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:21 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fabdd834-d007-4788-9c62-a65cf9222329" returned: 0 in 0.292s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] Lock "cinder-quobyte-fabdd834-d007-4788-9c62-a65cf9222329" released by "delete_volume" :: held 0.857s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] Created reservations ['0e90b4db-ffa1-44b2-8c6c-54285810395a', 'ce76d5b9-ae0b-44cf-b9e6-83af36dbbdef', 'bd2eda42-06c2-4f6b-8c7b-34c5b4696aa9', '56799d3f-3430-48fe-bdc0-5a6b6113a81b'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:48:21 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac81bcd8-0902-4699-9320-c13e27a437e1 tempest-VolumeDependencyTests-2049859779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507" returned: 0 in 0.358s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:21 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-ac81bcd8-0902-4699-9320-c13e27a437e1 tempest-VolumeDependencyTests-2049859779 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507 is being set with open permissions: ugo+rw Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac81bcd8-0902-4699-9320-c13e27a437e1 tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:21 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507 Sep 23 12:48:21 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:21 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:48:21 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:22 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac81bcd8-0902-4699-9320-c13e27a437e1 tempest-VolumeDependencyTests-2049859779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507" returned: 0 in 0.303s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac81bcd8-0902-4699-9320-c13e27a437e1 tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:22 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.info Sep 23 12:48:22 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:22 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.332s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:48:22 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] Deleted volume successfully. Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e39d5f3f-48e6-4bc3-8826-e537cd108dc8 tempest-VolumesActionsTest-1597267993 None] Lock "cinder-fabdd834-d007-4788-9c62-a65cf9222329-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:22 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac81bcd8-0902-4699-9320-c13e27a437e1 tempest-VolumeDependencyTests-2049859779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.info" returned: 0 in 0.326s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:22 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-ac81bcd8-0902-4699-9320-c13e27a437e1 tempest-VolumeDependencyTests-2049859779 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.info is being set with open permissions: ugo+rw Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac81bcd8-0902-4699-9320-c13e27a437e1 tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:22 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.info Sep 23 12:48:22 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Flow 'volume_create_manager' (ba9953b2-931e-4cd0-bd55-7f52ccf66edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a74d87-8b39-42ce-a7e7-fd8b7fc26a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a74d87-8b39-42ce-a7e7-fd8b7fc26a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-637480990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d16ba2cd-a65f-4124-a522-641a99aacab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c55e88d40c4dd4a504035b48de56f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:23Z,use_quota=True,user_id='1af271362d46400b88e9c6cd66d610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fcc9b46-3ff8-4c2a-97d0-9daedea42778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fcc9b46-3ff8-4c2a-97d0-9daedea42778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4cdca2-9340-4dee-b287-6ac7e203d871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4cdca2-9340-4dee-b287-6ac7e203d871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd16ba2cd-a65f-4124-a522-641a99aacab0', 'volume_name': 'volume-d16ba2cd-a65f-4124-a522-641a99aacab0', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1846ca-2d25-4e36-99d8-31308767774a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1846ca-2d25-4e36-99d8-31308767774a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6ac3b0-21af-451b-aee0-ed05c034f328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:22 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Volume d16ba2cd-a65f-4124-a522-641a99aacab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d16ba2cd-a65f-4124-a522-641a99aacab0', 'volume_size': 1} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:22 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac81bcd8-0902-4699-9320-c13e27a437e1 tempest-VolumeDependencyTests-2049859779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.info" returned: 0 in 0.319s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ac81bcd8-0902-4699-9320-c13e27a437e1 tempest-VolumeDependencyTests-2049859779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.465s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.142s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-87448693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbf4220a-2ce8-4cbd-8057-d36beaa8b879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24de3b6f509499b9a57e8f64e9b5e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:22Z,use_quota=True,user_id='73e73958b4564e05b02ab030479afec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Creating volume bbf4220a-2ce8-4cbd-8057-d36beaa8b879 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:48:22 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:48:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbf4220a-2ce8-4cbd-8057-d36beaa8b879 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:22 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbf4220a-2ce8-4cbd-8057-d36beaa8b879 1073741824 Sep 23 12:48:22 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:22 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ac81bcd8-0902-4699-9320-c13e27a437e1 tempest-VolumeDependencyTests-2049859779 None] Create snapshot completed successfully Sep 23 12:48:23 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbf4220a-2ce8-4cbd-8057-d36beaa8b879 1073741824" returned: 0 in 0.436s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbf4220a-2ce8-4cbd-8057-d36beaa8b879 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:23 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbf4220a-2ce8-4cbd-8057-d36beaa8b879 Sep 23 12:48:23 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:23 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbf4220a-2ce8-4cbd-8057-d36beaa8b879" returned: 0 in 0.265s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:48:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.797s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-637480990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d16ba2cd-a65f-4124-a522-641a99aacab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c55e88d40c4dd4a504035b48de56f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:23Z,use_quota=True,user_id='1af271362d46400b88e9c6cd66d610ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:48:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Creating volume d16ba2cd-a65f-4124-a522-641a99aacab0 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:48:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:48:23 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:48:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d16ba2cd-a65f-4124-a522-641a99aacab0 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:23 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d16ba2cd-a65f-4124-a522-641a99aacab0 1073741824 Sep 23 12:48:23 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22938a98-a7e7-4f98-b52c-a266d090da32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbf4220a-2ce8-4cbd-8057-d36beaa8b879', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5765f778-9e1e-4859-8ded-8f58ae1542dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:23 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Volume volume-bbf4220a-2ce8-4cbd-8057-d36beaa8b879 (bbf4220a-2ce8-4cbd-8057-d36beaa8b879): created successfully Sep 23 12:48:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5765f778-9e1e-4859-8ded-8f58ae1542dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Flow 'volume_create_manager' (62e57a8f-08d2-4b3b-afef-46dde341a623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:23 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-1e461c31-b524-40e2-8b51-0ebed92c8561 tempest-ProjectReaderTests-1496657168 None] Created volume successfully. Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Flow 'volume_create_manager' (67048bd0-e106-476f-91cf-c6d463917674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ceb8ee-5b0c-443f-a37a-f216998e06f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:24 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ceb8ee-5b0c-443f-a37a-f216998e06f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2088102131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e02026-ac24-45c3-8bc0-9758900a0b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2546aa06874f2085d15d6547c392f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a3ad3df9-d497-4215-8013-a9e09205c507,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:24Z,use_quota=True,user_id='15cae67e320d4967a01395ed9ec36744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c66449d-33db-4416-bd08-6590295b9b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c66449d-33db-4416-bd08-6590295b9b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16f63fdf-d9f6-4035-9a61-0df0dc0d371d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16f63fdf-d9f6-4035-9a61-0df0dc0d371d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '65e02026-ac24-45c3-8bc0-9758900a0b7f', 'volume_name': 'volume-65e02026-ac24-45c3-8bc0-9758900a0b7f', 'volume_size': 1, 'snapshot_id': 'a3ad3df9-d497-4215-8013-a9e09205c507'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ad5bbd-aa12-4e56-8660-32bd8c3905b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ad5bbd-aa12-4e56-8660-32bd8c3905b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50425f78-4e17-43a7-9801-7dffca5ed628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:24 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Volume 65e02026-ac24-45c3-8bc0-9758900a0b7f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-65e02026-ac24-45c3-8bc0-9758900a0b7f', 'volume_size': 1, 'snapshot_id': 'a3ad3df9-d497-4215-8013-a9e09205c507'} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d16ba2cd-a65f-4124-a522-641a99aacab0 1073741824" returned: 0 in 0.684s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d16ba2cd-a65f-4124-a522-641a99aacab0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:24 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d16ba2cd-a65f-4124-a522-641a99aacab0 Sep 23 12:48:24 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:24 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d16ba2cd-a65f-4124-a522-641a99aacab0" returned: 0 in 0.242s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.269s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Acquiring lock "cinder-quobyte-a3ad3df9-d497-4215-8013-a9e09205c507-65e02026-ac24-45c3-8bc0-9758900a0b7f" by "_create_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6ac3b0-21af-451b-aee0-ed05c034f328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d16ba2cd-a65f-4124-a522-641a99aacab0', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f4c0b1-187e-4a58-8a31-95ffedad3e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Lock "cinder-quobyte-a3ad3df9-d497-4215-8013-a9e09205c507-65e02026-ac24-45c3-8bc0-9758900a0b7f" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Creating volume 65e02026-ac24-45c3-8bc0-9758900a0b7f from snapshot a3ad3df9-d497-4215-8013-a9e09205c507 {{(pid=86085) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Acquiring lock "cinder-quobyte-65e02026-ac24-45c3-8bc0-9758900a0b7f" by "_copy_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:24 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Volume volume-d16ba2cd-a65f-4124-a522-641a99aacab0 (d16ba2cd-a65f-4124-a522-641a99aacab0): created successfully Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f4c0b1-187e-4a58-8a31-95ffedad3e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Flow 'volume_create_manager' (ba9953b2-931e-4cd0-bd55-7f52ccf66edc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Lock "cinder-quobyte-65e02026-ac24-45c3-8bc0-9758900a0b7f" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] snapshot: a3ad3df9-d497-4215-8013-a9e09205c507, volume: 65e02026-ac24-45c3-8bc0-9758900a0b7f, {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 12:48:24 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-69ba0729-5fcf-453f-b1e8-79ccd352a602 tempest-VolumesActionsTest-742956622 None] Created volume successfully. Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a05b03-6f30-48e9-912f-eb67e8b67333]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:24 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507 Sep 23 12:48:24 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] Acquiring lock "cinder-bbf4220a-2ce8-4cbd-8057-d36beaa8b879-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] Lock "cinder-bbf4220a-2ce8-4cbd-8057-d36beaa8b879-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] Acquiring lock "cinder-quobyte-bbf4220a-2ce8-4cbd-8057-d36beaa8b879" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] Lock "cinder-quobyte-bbf4220a-2ce8-4cbd-8057-d36beaa8b879" acquired by "delete_volume" :: waited 0.033s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13cdbd4-6b02-439f-9d76-ed426fc0be49]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbf4220a-2ce8-4cbd-8057-d36beaa8b879 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:25 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbf4220a-2ce8-4cbd-8057-d36beaa8b879 Sep 23 12:48:25 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:25 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507" returned: 0 in 0.526s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1935bd26-fb9b-4ff5-99be-e6483cab84cb]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:25 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 Sep 23 12:48:25 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:25 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbf4220a-2ce8-4cbd-8057-d36beaa8b879" returned: 0 in 0.477s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbf4220a-2ce8-4cbd-8057-d36beaa8b879 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:25 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbf4220a-2ce8-4cbd-8057-d36beaa8b879 Sep 23 12:48:25 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:25 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] Acquiring lock "cinder-d16ba2cd-a65f-4124-a522-641a99aacab0-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6" returned: 0 in 0.510s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] will copy from snapshot at /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Creating direct copy from snapshot {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG cinder.utils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Path /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e02026-ac24-45c3-8bc0-9758900a0b7f not found in is_blk_device check {{(pid=86085) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e02026-ac24-45c3-8bc0-9758900a0b7f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] Lock "cinder-d16ba2cd-a65f-4124-a522-641a99aacab0-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:25 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e02026-ac24-45c3-8bc0-9758900a0b7f Sep 23 12:48:25 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] Acquiring lock "cinder-quobyte-d16ba2cd-a65f-4124-a522-641a99aacab0" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] Lock "cinder-quobyte-d16ba2cd-a65f-4124-a522-641a99aacab0" acquired by "delete_volume" :: waited 0.030s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06cdfe8-e817-4935-9363-2ebcfa2d4e48]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d16ba2cd-a65f-4124-a522-641a99aacab0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:25 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-bbf4220a-2ce8-4cbd-8057-d36beaa8b879" returned: 0 in 0.362s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] Lock "cinder-quobyte-bbf4220a-2ce8-4cbd-8057-d36beaa8b879" released by "delete_volume" :: held 0.920s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:26 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] Created reservations ['37264962-43bc-4f7e-bfe8-93483ed9cbe5', '85cac48d-f884-4c6d-ae4a-dea017c61133', '4cc0ce62-df34-48d4-821b-8f451832d34c', 'c6d02ced-05a5-4bdc-a157-ca96a2fe3e60'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:48:26 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d16ba2cd-a65f-4124-a522-641a99aacab0 Sep 23 12:48:26 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:26 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:48:26 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:26 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d16ba2cd-a65f-4124-a522-641a99aacab0" returned: 0 in 0.509s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d16ba2cd-a65f-4124-a522-641a99aacab0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:26 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d16ba2cd-a65f-4124-a522-641a99aacab0 Sep 23 12:48:26 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:26 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.365s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:26 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:48:26 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] Deleted volume successfully. Sep 23 12:48:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4684d108-b78a-480b-9c00-dd86fbf16181 tempest-ProjectReaderTests-1496657168 None] Lock "cinder-bbf4220a-2ce8-4cbd-8057-d36beaa8b879-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:27 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d16ba2cd-a65f-4124-a522-641a99aacab0" returned: 0 in 0.602s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] Lock "cinder-quobyte-d16ba2cd-a65f-4124-a522-641a99aacab0" released by "delete_volume" :: held 1.172s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:27 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] Created reservations ['b4d3c6e4-c45d-493c-9f1c-46672720e2e5', '1e981ba5-a05f-4687-8da3-79680fb89f30', '9fa3f994-30b9-4766-a657-7b4aca369490', '1a01c65c-df52-4641-879d-4b55062c165c'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:48:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:27 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:48:27 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:27 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.404s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:27 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:48:27 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] Deleted volume successfully. Sep 23 12:48:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9dc1188f-d423-4346-b57a-c27adbbb1934 tempest-VolumesActionsTest-742956622 None] Lock "cinder-d16ba2cd-a65f-4124-a522-641a99aacab0-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:34 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e02026-ac24-45c3-8bc0-9758900a0b7f" returned: 0 in 8.717s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:34 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Image conversion details: src /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6, size 1024.00 MB, duration 8.72 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e02026-ac24-45c3-8bc0-9758900a0b7f {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:48:34 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Converted 1024.00 MB image at 117.46 MB/s Sep 23 12:48:34 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e02026-ac24-45c3-8bc0-9758900a0b7f is being set with open permissions: ugo+rw Sep 23 12:48:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e02026-ac24-45c3-8bc0-9758900a0b7f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:34 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e02026-ac24-45c3-8bc0-9758900a0b7f Sep 23 12:48:34 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:34 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e02026-ac24-45c3-8bc0-9758900a0b7f" returned: 0 in 0.392s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Lock "cinder-quobyte-65e02026-ac24-45c3-8bc0-9758900a0b7f" released by "_copy_volume_from_snapshot" :: held 10.279s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Lock "cinder-quobyte-a3ad3df9-d497-4215-8013-a9e09205c507-65e02026-ac24-45c3-8bc0-9758900a0b7f" released by "_create_volume_from_snapshot" :: held 10.430s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.467s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50425f78-4e17-43a7-9801-7dffca5ed628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e02026-ac24-45c3-8bc0-9758900a0b7f', 'volume_size': 1, 'snapshot_id': 'a3ad3df9-d497-4215-8013-a9e09205c507'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31588d8b-7b46-4848-8578-9ba865ad3643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:35 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Volume volume-65e02026-ac24-45c3-8bc0-9758900a0b7f (65e02026-ac24-45c3-8bc0-9758900a0b7f): created successfully Sep 23 12:48:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31588d8b-7b46-4848-8578-9ba865ad3643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Flow 'volume_create_manager' (67048bd0-e106-476f-91cf-c6d463917674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:35 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-e68b9600-abb7-45bb-a484-506d1ebc1af1 tempest-VolumeDependencyTests-2049859779 None] Created volume successfully. Sep 23 12:48:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] Acquiring lock "cinder-a3ad3df9-d497-4215-8013-a9e09205c507-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] Lock "cinder-a3ad3df9-d497-4215-8013-a9e09205c507-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] Acquiring lock "cinder-quobyte-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] Lock "cinder-quobyte-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] Acquiring lock "cinder-quobyte-a3ad3df9-d497-4215-8013-a9e09205c507" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] Lock "cinder-quobyte-a3ad3df9-d497-4215-8013-a9e09205c507" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] Deleting offline snapshot a3ad3df9-d497-4215-8013-a9e09205c507 of volume 3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:48:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] snapshot_file for this snap is: volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:48:35 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23ff0e9-a197-4cc7-ac76-dd27235a2db9]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:35 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507 Sep 23 12:48:35 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:35 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507" returned: 0 in 0.428s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:48:36 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47d00f7-9d09-4c86-80e0-5a6c7b075086]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:36 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 Sep 23 12:48:36 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:36 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6" returned: 0 in 0.619s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:36 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507 Sep 23 12:48:36 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:37 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507" returned: 0 in 0.411s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:37 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507 Sep 23 12:48:37 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:37 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6.a3ad3df9-d497-4215-8013-a9e09205c507" returned: 0 in 0.278s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] Lock "cinder-quobyte-a3ad3df9-d497-4215-8013-a9e09205c507" released by "_delete_snapshot" :: held 1.885s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] Lock "cinder-quobyte-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6" released by "delete_snapshot" :: held 1.922s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:37 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] Created reservations ['2d922634-b257-40df-b245-06a9a975fc89', 'e3c76727-a831-443b-9637-256a25d0bdb1', '5a3dd268-506e-4626-b365-37ebccae4cec', 'fe49c641-63f9-4b05-a2b4-0c6436a905cf'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:48:37 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] Delete snapshot completed successfully. Sep 23 12:48:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-56d0d374-f3cb-44a7-b94d-ef0068d5108e tempest-VolumeDependencyTests-2049859779 None] Lock "cinder-a3ad3df9-d497-4215-8013-a9e09205c507-delete_snapshot" released by "delete_snapshot" :: held 2.084s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] Acquiring lock "cinder-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] Lock "cinder-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] Acquiring lock "cinder-quobyte-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] Lock "cinder-quobyte-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6" acquired by "delete_volume" :: waited 0.026s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:37 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea4d92e-7102-419a-bb03-65dc2dc13aa2]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:37 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 Sep 23 12:48:37 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:38 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6" returned: 0 in 0.457s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:38 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6 Sep 23 12:48:38 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:38 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6" returned: 0 in 0.313s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:38 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] Lock "cinder-quobyte-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6" released by "delete_volume" :: held 0.858s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:38 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] Created reservations ['e9d8ad47-122f-4f99-89a2-03319cf4dbce', 'be4ca6a1-2446-46f6-ae0c-9a0920350c97', '11c273b3-edda-4496-9833-154cffe8852a', '54d257d0-a3bc-452c-a42b-c0761c9a0011'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:48:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:38 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:48:38 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:38 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] Acquiring lock "cinder-65e02026-ac24-45c3-8bc0-9758900a0b7f-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:38 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] Lock "cinder-65e02026-ac24-45c3-8bc0-9758900a0b7f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:38 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] Acquiring lock "cinder-quobyte-65e02026-ac24-45c3-8bc0-9758900a0b7f" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:39 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] Lock "cinder-quobyte-65e02026-ac24-45c3-8bc0-9758900a0b7f" acquired by "delete_volume" :: waited 0.023s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:39 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[42138f07-0d51-4415-9f5d-9f65868bd251]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e02026-ac24-45c3-8bc0-9758900a0b7f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:39 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.332s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:39 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:48:39 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] Deleted volume successfully. Sep 23 12:48:39 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-987d501e-a030-474c-b69b-fc3bd2e968f4 tempest-VolumeDependencyTests-2049859779 None] Lock "cinder-3e5b8a09-4292-4dc0-8fc4-b92a2be8efb6-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:39 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e02026-ac24-45c3-8bc0-9758900a0b7f Sep 23 12:48:39 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:39 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e02026-ac24-45c3-8bc0-9758900a0b7f" returned: 0 in 0.496s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e02026-ac24-45c3-8bc0-9758900a0b7f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:39 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e02026-ac24-45c3-8bc0-9758900a0b7f Sep 23 12:48:39 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:39 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e02026-ac24-45c3-8bc0-9758900a0b7f" returned: 0 in 0.305s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:39 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] Lock "cinder-quobyte-65e02026-ac24-45c3-8bc0-9758900a0b7f" released by "delete_volume" :: held 0.887s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:40 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] Created reservations ['a79ea8e1-0843-4690-a6e6-55bd2fb66d17', 'fe372f96-332d-46ee-8657-7c038a1f82cf', '2ccbacea-0778-44eb-b199-f9cc68be4852', '4c81fc0e-a35f-43a0-b0cc-1c16f112b10c'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:48:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:40 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:48:40 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:40 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.325s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:40 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:48:40 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] Deleted volume successfully. Sep 23 12:48:40 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8fd658dc-83d5-44fc-ad1b-1c359a937b76 tempest-VolumeDependencyTests-2049859779 None] Lock "cinder-65e02026-ac24-45c3-8bc0-9758900a0b7f-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:48:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:41 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:48:41 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:41 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.317s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:41 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:48:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:48:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:48:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:48:44 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:48:44 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Flow 'volume_create_manager' (0eaa8a29-38a5-486f-8f89-aedfd115c730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:44 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fea752-77d3-4be3-8cf2-19bac85b55b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:44 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fea752-77d3-4be3-8cf2-19bac85b55b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73cba93-e69e-4ead-bbeb-038ef7cc74a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c6507559ee426fb1da10b35e6170e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:45Z,use_quota=True,user_id='3575ecd314bf4190955d47a4591928b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab470757-8699-42df-9d3e-f7aa3ba1e7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab470757-8699-42df-9d3e-f7aa3ba1e7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb0a2000-ca5d-4392-a194-5edad0b70fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb0a2000-ca5d-4392-a194-5edad0b70fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd73cba93-e69e-4ead-bbeb-038ef7cc74a0', 'volume_name': 'volume-d73cba93-e69e-4ead-bbeb-038ef7cc74a0', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3498ae70-57bb-4107-bc0d-85c0d20d9c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3498ae70-57bb-4107-bc0d-85c0d20d9c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ae4f2e-978d-4040-963a-0db7810cec6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:45 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Volume d73cba93-e69e-4ead-bbeb-038ef7cc74a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d73cba93-e69e-4ead-bbeb-038ef7cc74a0', 'volume_size': 1} Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73cba93-e69e-4ead-bbeb-038ef7cc74a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c6507559ee426fb1da10b35e6170e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:45Z,use_quota=True,user_id='3575ecd314bf4190955d47a4591928b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Creating volume d73cba93-e69e-4ead-bbeb-038ef7cc74a0 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:48:45 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d73cba93-e69e-4ead-bbeb-038ef7cc74a0 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:45 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d73cba93-e69e-4ead-bbeb-038ef7cc74a0 1073741824 Sep 23 12:48:45 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:45 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d73cba93-e69e-4ead-bbeb-038ef7cc74a0 1073741824" returned: 0 in 0.609s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d73cba93-e69e-4ead-bbeb-038ef7cc74a0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:45 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d73cba93-e69e-4ead-bbeb-038ef7cc74a0 Sep 23 12:48:45 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:46 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d73cba93-e69e-4ead-bbeb-038ef7cc74a0" returned: 0 in 0.328s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:46 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:48:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ae4f2e-978d-4040-963a-0db7810cec6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d73cba93-e69e-4ead-bbeb-038ef7cc74a0', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb060e5-bdc1-439a-9bf4-ea9c5fad4e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:46 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Volume volume-d73cba93-e69e-4ead-bbeb-038ef7cc74a0 (d73cba93-e69e-4ead-bbeb-038ef7cc74a0): created successfully Sep 23 12:48:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb060e5-bdc1-439a-9bf4-ea9c5fad4e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Flow 'volume_create_manager' (0eaa8a29-38a5-486f-8f89-aedfd115c730) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:46 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-6a1a5faa-af3f-4887-84f5-44b0d8c2abe8 tempest-CinderUnicodeTest-950064350 None] Created volume successfully. Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Flow 'volume_create_manager' (c17616b3-1d53-4785-a63e-96a76b61b496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c49171-fb54-4dc9-a627-1b2b0c6e6fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c49171-fb54-4dc9-a627-1b2b0c6e6fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-890961120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d06c83d-d4db-48d1-b5cf-4160cb2c19b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c6507559ee426fb1da10b35e6170e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:48Z,use_quota=True,user_id='3575ecd314bf4190955d47a4591928b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8eb435-ce3c-4c0d-8b2b-1d11d004b4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8eb435-ce3c-4c0d-8b2b-1d11d004b4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562d7e9f-0b98-4127-9dbf-5773021e12ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562d7e9f-0b98-4127-9dbf-5773021e12ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d06c83d-d4db-48d1-b5cf-4160cb2c19b9', 'volume_name': 'volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9805023-4bc0-42f4-8924-53a2b9a3375e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9805023-4bc0-42f4-8924-53a2b9a3375e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb8efc4-74f7-465a-a192-8d9bc2266e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:47 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Volume 9d06c83d-d4db-48d1-b5cf-4160cb2c19b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9', 'volume_size': 1} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-890961120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d06c83d-d4db-48d1-b5cf-4160cb2c19b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c6507559ee426fb1da10b35e6170e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:48Z,use_quota=True,user_id='3575ecd314bf4190955d47a4591928b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Creating volume 9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:48:47 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:48:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:47 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 1073741824 Sep 23 12:48:47 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:48 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 1073741824" returned: 0 in 0.656s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:48 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 Sep 23 12:48:48 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:49 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9" returned: 0 in 0.605s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:48:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb8efc4-74f7-465a-a192-8d9bc2266e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e7137b-06b6-4f09-9cd2-0b8225f97308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:49 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Volume volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 (9d06c83d-d4db-48d1-b5cf-4160cb2c19b9): created successfully Sep 23 12:48:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e7137b-06b6-4f09-9cd2-0b8225f97308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Flow 'volume_create_manager' (c17616b3-1d53-4785-a63e-96a76b61b496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:49 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-aef76ec4-bb74-48b8-a49b-299704bb63f3 tempest-CinderUnicodeTest-950064350 None] Created volume successfully. Sep 23 12:48:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-30f2ee05-4669-4be4-861e-837a71c14f13 tempest-CinderUnicodeTest-950064350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-30f2ee05-4669-4be4-861e-837a71c14f13 tempest-CinderUnicodeTest-950064350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-30f2ee05-4669-4be4-861e-837a71c14f13 tempest-CinderUnicodeTest-950064350 None] Creating offline snapshot 6ee0cc03-c714-418a-8615-e60e843823e5 of volume 9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:48:50 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[930ceb84-40fb-46da-bfd2-895ad65c5c13]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-30f2ee05-4669-4be4-861e-837a71c14f13 tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:50 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 Sep 23 12:48:50 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:50 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-30f2ee05-4669-4be4-861e-837a71c14f13 tempest-CinderUnicodeTest-950064350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9" returned: 0 in 0.534s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-30f2ee05-4669-4be4-861e-837a71c14f13 tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:50 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5 1G Sep 23 12:48:50 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:51 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-51e45ad5-f605-49af-ba85-5bd7de5f97cd tempest-TestShelveInstance-635120961 None] Terminate volume connection completed successfully. Sep 23 12:48:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-51e45ad5-f605-49af-ba85-5bd7de5f97cd tempest-TestShelveInstance-635120961 None] Deleting attachment 29b38f50-89dc-4b7d-8bdf-c4aaa304a618. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:48:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] Acquiring lock "cinder-fe155ffd-3136-465a-9d87-8500fe1d8f7e-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:51 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] Lock "cinder-fe155ffd-3136-465a-9d87-8500fe1d8f7e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-30f2ee05-4669-4be4-861e-837a71c14f13 tempest-CinderUnicodeTest-950064350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5 1G" returned: 0 in 0.751s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-30f2ee05-4669-4be4-861e-837a71c14f13 tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:51 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5 Sep 23 12:48:51 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] Acquiring lock "cinder-quobyte-fe155ffd-3136-465a-9d87-8500fe1d8f7e" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] Lock "cinder-quobyte-fe155ffd-3136-465a-9d87-8500fe1d8f7e" acquired by "delete_volume" :: waited 0.036s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:51 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6db6fd-641a-4a72-96ec-1a95f3d6fde0]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:52 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e Sep 23 12:48:52 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:52 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-30f2ee05-4669-4be4-861e-837a71c14f13 tempest-CinderUnicodeTest-950064350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5" returned: 0 in 0.663s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:52 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-30f2ee05-4669-4be4-861e-837a71c14f13 tempest-CinderUnicodeTest-950064350 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5 is being set with open permissions: ugo+rw Sep 23 12:48:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-30f2ee05-4669-4be4-861e-837a71c14f13 tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:52 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5 Sep 23 12:48:52 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:52 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e" returned: 0 in 0.561s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:52 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e Sep 23 12:48:52 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:52 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-30f2ee05-4669-4be4-861e-837a71c14f13 tempest-CinderUnicodeTest-950064350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5" returned: 0 in 0.339s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-30f2ee05-4669-4be4-861e-837a71c14f13 tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:52 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.info Sep 23 12:48:52 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:52 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fe155ffd-3136-465a-9d87-8500fe1d8f7e" returned: 0 in 0.432s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] Lock "cinder-quobyte-fe155ffd-3136-465a-9d87-8500fe1d8f7e" released by "delete_volume" :: held 1.075s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:52 devstack cinder-volume[86085]: DEBUG cinder.quota [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] Created reservations ['59c6b453-67e4-4ab5-88bf-63b7947e8daa', '4d773bc7-58ca-4f46-94f9-90b61acdd78f', 'f89fc582-c4bd-446e-95fb-dfb5ed949fa9', '05cbcd1a-c01c-4cec-b79a-14ffdf105430'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:48:53 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-30f2ee05-4669-4be4-861e-837a71c14f13 tempest-CinderUnicodeTest-950064350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.info" returned: 0 in 0.361s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:53 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-30f2ee05-4669-4be4-861e-837a71c14f13 tempest-CinderUnicodeTest-950064350 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.info is being set with open permissions: ugo+rw Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-30f2ee05-4669-4be4-861e-837a71c14f13 tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:53 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.info Sep 23 12:48:53 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:53 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:48:53 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:53 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-30f2ee05-4669-4be4-861e-837a71c14f13 tempest-CinderUnicodeTest-950064350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.info" returned: 0 in 0.397s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-30f2ee05-4669-4be4-861e-837a71c14f13 tempest-CinderUnicodeTest-950064350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.194s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:53 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-30f2ee05-4669-4be4-861e-837a71c14f13 tempest-CinderUnicodeTest-950064350 None] Create snapshot completed successfully Sep 23 12:48:53 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.425s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG cinder.manager [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:48:53 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] Deleted volume successfully. Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Flow 'volume_create_manager' (3966910f-8d44-4745-969a-cfda3d40c342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d248a4c-a78a-41c6-a5f5-739dd93ab31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [req-3c469dbf-c1a3-472f-a5b8-3e5e578e8081 req-60c24d5c-4b35-4225-a87b-05e77882c375 tempest-TestShelveInstance-635120961 None] Lock "cinder-fe155ffd-3136-465a-9d87-8500fe1d8f7e-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d248a4c-a78a-41c6-a5f5-739dd93ab31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2061352366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87bcac24-938b-4658-8267-ce6b74c90a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58fe5fd09c04e7c8d812ca58f767d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:54Z,use_quota=True,user_id='86e8b02472024980b4162e18b7109c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7486e7ab-db5e-4456-96ec-ce030612651c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7486e7ab-db5e-4456-96ec-ce030612651c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ff3428-0151-4fb9-b6d7-a5108220b148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:53 devstack cinder-volume[86085]: DEBUG cinder.image.glance [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Creating Keystone auth plugin from conf {{(pid=86085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 12:48:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ff3428-0151-4fb9-b6d7-a5108220b148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '87bcac24-938b-4658-8267-ce6b74c90a47', 'volume_name': 'volume-87bcac24-938b-4658-8267-ce6b74c90a47', 'volume_size': 1, 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3c5121b794a4715babb77a8b7da12a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'created_at': datetime.datetime(2026, 9, 23, 10, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 27, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ace08b6-0969-4ed8-8698-8ad393519aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ace08b6-0969-4ed8-8698-8ad393519aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:48:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884f7d94-261f-4384-8314-e8422b7704a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:48:54 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Volume 87bcac24-938b-4658-8267-ce6b74c90a47: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-87bcac24-938b-4658-8267-ce6b74c90a47', 'volume_size': 1, 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3c5121b794a4715babb77a8b7da12a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'created_at': datetime.datetime(2026, 9, 23, 10, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 27, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 12:48:54 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Trying to clone 87bcac24-938b-4658-8267-ce6b74c90a47 from image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]). {{(pid=86085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 12:48:54 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_n8p8l3rgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 12:48:54 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Image download 20.69 MB at 20.69 MB/s Sep 23 12:48:54 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd370b95-f9b9-4eda-82c8-d6f94db0e614]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_n8p8l3rgdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] Acquiring lock "cinder-6ee0cc03-c714-418a-8615-e60e843823e5-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] Lock "cinder-6ee0cc03-c714-418a-8615-e60e843823e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] Acquiring lock "cinder-quobyte-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] Lock "cinder-quobyte-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] Acquiring lock "cinder-quobyte-6ee0cc03-c714-418a-8615-e60e843823e5" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] Lock "cinder-quobyte-6ee0cc03-c714-418a-8615-e60e843823e5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] Deleting offline snapshot 6ee0cc03-c714-418a-8615-e60e843823e5 of volume 9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:48:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] snapshot_file for this snap is: volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:48:54 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f03b035-5d26-4054-b252-aa121c1d5b7d]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:54 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_n8p8l3rgdevstack@QuobyteHD Sep 23 12:48:54 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:54 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5 Sep 23 12:48:54 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:55 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_n8p8l3rgdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Temporary image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 is fetched for user 86e8b02472024980b4162e18b7109c76. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb5d4d2-bae5-4c11-beec-6b5eb6e60cd3]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_n8p8l3rgdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:55 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5" returned: 0 in 0.438s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feb8661-2f8a-4c75-9a10-e51df53af945]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:55 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_n8p8l3rgdevstack@QuobyteHD Sep 23 12:48:55 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:55 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 Sep 23 12:48:55 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:55 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_n8p8l3rgdevstack@QuobyteHD" returned: 0 in 0.552s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2061352366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87bcac24-938b-4658-8267-ce6b74c90a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58fe5fd09c04e7c8d812ca58f767d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:48:54Z,use_quota=True,user_id='86e8b02472024980b4162e18b7109c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Creating volume 87bcac24-938b-4658-8267-ce6b74c90a47 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:48:55 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-87bcac24-938b-4658-8267-ce6b74c90a47 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:55 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-87bcac24-938b-4658-8267-ce6b74c90a47 1073741824 Sep 23 12:48:55 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:55 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9" returned: 0 in 0.668s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:55 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5 Sep 23 12:48:56 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:56 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5" returned: 0 in 0.442s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:56 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-87bcac24-938b-4658-8267-ce6b74c90a47 1073741824" returned: 0 in 0.655s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:56 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5 Sep 23 12:48:56 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-87bcac24-938b-4658-8267-ce6b74c90a47 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:56 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-87bcac24-938b-4658-8267-ce6b74c90a47 Sep 23 12:48:56 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:56 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-87bcac24-938b-4658-8267-ce6b74c90a47" returned: 0 in 0.304s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:48:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:56 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9.6ee0cc03-c714-418a-8615-e60e843823e5" returned: 0 in 0.420s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:56 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Attempting download of 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}])) to volume 87bcac24-938b-4658-8267-ce6b74c90a47. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 12:48:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] Lock "cinder-quobyte-6ee0cc03-c714-418a-8615-e60e843823e5" released by "_delete_snapshot" :: held 2.130s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] Lock "cinder-quobyte-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9" released by "delete_snapshot" :: held 2.167s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:56 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd5647a-bdb9-462d-b439-6f94ea2e5498]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_melcrspv {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:57 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] Created reservations ['d756acfc-1e98-4078-b0be-61c883f8bc78', 'c98311c3-cb03-4b5d-ab47-c6a5dfefb395', 'bbfb7b3f-c013-49ad-aa13-0ac8509fa2cf', 'e83cd026-e501-4ffa-8095-ca4aea86d09a'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:48:57 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_melcrspv Sep 23 12:48:57 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] Delete snapshot completed successfully. Sep 23 12:48:57 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0971d7ce-de65-4c01-9e11-3727059ba905 tempest-CinderUnicodeTest-950064350 None] Lock "cinder-6ee0cc03-c714-418a-8615-e60e843823e5-delete_snapshot" released by "delete_snapshot" :: held 2.374s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:57 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_melcrspv" returned: 0 in 0.403s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_melcrspv {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:57 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_melcrspv Sep 23 12:48:57 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:57 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_melcrspv" returned: 1 in 0.391s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_melcrspv' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:48:57 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7b008d-884f-475c-92ef-5b571c78835f]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_n8p8l3rgdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:57 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_n8p8l3rgdevstack@QuobyteHD Sep 23 12:48:57 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] Acquiring lock "cinder-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] Lock "cinder-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] Acquiring lock "cinder-quobyte-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:48:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] Lock "cinder-quobyte-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9" acquired by "delete_volume" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:48:58 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5dc85c-8acc-45a5-9ede-b2370d581b9c]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:48:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:58 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_n8p8l3rgdevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:58 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 was qcow2, converting to qcow2 {{(pid=86085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 12:48:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_n8p8l3rgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-87bcac24-938b-4658-8267-ce6b74c90a47 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:58 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_n8p8l3rgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-87bcac24-938b-4658-8267-ce6b74c90a47 Sep 23 12:48:58 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:58 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 Sep 23 12:48:58 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:58 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9" returned: 0 in 0.535s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:58 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9 Sep 23 12:48:58 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:59 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9" returned: 0 in 0.413s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] Lock "cinder-quobyte-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9" released by "delete_volume" :: held 1.048s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:48:59 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] Created reservations ['307b16bb-adbf-43b1-816d-021d90c050f6', '22a7f633-f544-498c-aea8-83eb69d3da72', 'adebd390-8e38-4b3f-a932-1db055dbc464', 'be817016-cc2c-4d4e-8b54-69719ba9e1ab'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:48:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:48:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:48:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:48:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:48:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:48:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:48:59 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:48:59 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:48:59 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Sep 23 12:48:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.352s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:48:59 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:48:59 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] Deleted volume successfully. Sep 23 12:48:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6c4f6f1c-9412-47c0-b4e8-0dc53f51e37f tempest-CinderUnicodeTest-950064350 None] Lock "cinder-9d06c83d-d4db-48d1-b5cf-4160cb2c19b9-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] Acquiring lock "cinder-d73cba93-e69e-4ead-bbeb-038ef7cc74a0-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] Lock "cinder-d73cba93-e69e-4ead-bbeb-038ef7cc74a0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] Acquiring lock "cinder-quobyte-d73cba93-e69e-4ead-bbeb-038ef7cc74a0" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] Lock "cinder-quobyte-d73cba93-e69e-4ead-bbeb-038ef7cc74a0" acquired by "delete_volume" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[9396ea83-49d2-4f0b-b498-926b19525a77]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d73cba93-e69e-4ead-bbeb-038ef7cc74a0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:00 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d73cba93-e69e-4ead-bbeb-038ef7cc74a0 Sep 23 12:49:00 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Flow 'volume_create_manager' (16f5e156-f548-48f5-81b8-3f41d11a80c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29fff9e7-d507-4c75-aafe-5a152b34a23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29fff9e7-d507-4c75-aafe-5a152b34a23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1148577778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb234cc-04a0-4bd0-ba0b-dbcdfee79373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9c23299122439b853fc7c38c893dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:49:01Z,use_quota=True,user_id='0f58a6fd0f954553b4e671d8dfca2f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9d349e-8c22-4d81-aa71-26932dbd35cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9d349e-8c22-4d81-aa71-26932dbd35cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9037c7ac-5152-4d31-95cd-ee62c1f93e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9037c7ac-5152-4d31-95cd-ee62c1f93e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb234cc-04a0-4bd0-ba0b-dbcdfee79373', 'volume_name': 'volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5293b9b5-8c43-49db-894f-d35ff988a7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5293b9b5-8c43-49db-894f-d35ff988a7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28a3da6-5695-4512-b9b8-288634f22a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:00 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Volume ccb234cc-04a0-4bd0-ba0b-dbcdfee79373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373', 'volume_size': 1} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1148577778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb234cc-04a0-4bd0-ba0b-dbcdfee79373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9c23299122439b853fc7c38c893dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:49:01Z,use_quota=True,user_id='0f58a6fd0f954553b4e671d8dfca2f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Creating volume ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:49:00 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:49:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:01 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 1073741824 Sep 23 12:49:01 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:01 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d73cba93-e69e-4ead-bbeb-038ef7cc74a0" returned: 0 in 0.559s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d73cba93-e69e-4ead-bbeb-038ef7cc74a0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:01 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d73cba93-e69e-4ead-bbeb-038ef7cc74a0 Sep 23 12:49:01 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:01 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_n8p8l3rgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-87bcac24-938b-4658-8267-ce6b74c90a47" returned: 0 in 2.937s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_n8p8l3rgdevstack@QuobyteHD, size 112.00 MB, duration 2.94 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-87bcac24-938b-4658-8267-ce6b74c90a47 {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:49:01 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Converted 112.00 MB image at 38.12 MB/s Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-87bcac24-938b-4658-8267-ce6b74c90a47 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:01 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-87bcac24-938b-4658-8267-ce6b74c90a47 1G Sep 23 12:49:01 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:01 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d73cba93-e69e-4ead-bbeb-038ef7cc74a0" returned: 0 in 0.333s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] Lock "cinder-quobyte-d73cba93-e69e-4ead-bbeb-038ef7cc74a0" released by "delete_volume" :: held 0.954s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] Created reservations ['dbd5c5ff-a14f-4016-a9e6-014f14370ba8', '63d2a239-a181-464e-a6a0-70327f6fa85f', '180ed571-364c-4bd2-a659-de1d2d329f02', '321433c4-cf3c-46a8-b63e-3d6b852605d6'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:01 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-87bcac24-938b-4658-8267-ce6b74c90a47 1G" returned: 0 in 0.454s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:01 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Downloaded image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}])) to volume 87bcac24-938b-4658-8267-ce6b74c90a47 successfully. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 12:49:01 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Temporary image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 for user 86e8b02472024980b4162e18b7109c76 is deleted. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Marking volume 87bcac24-938b-4658-8267-ce6b74c90a47 as bootable. {{(pid=86085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Copying metadata from image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 to 87bcac24-938b-4658-8267-ce6b74c90a47. {{(pid=86085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Creating volume glance metadata for volume 87bcac24-938b-4658-8267-ce6b74c90a47 backed by image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 12:49:01 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 1073741824" returned: 0 in 0.650s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:01 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 Sep 23 12:49:01 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884f7d94-261f-4384-8314-e8422b7704a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87bcac24-938b-4658-8267-ce6b74c90a47', 'volume_size': 1, 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3c5121b794a4715babb77a8b7da12a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'created_at': datetime.datetime(2026, 9, 23, 10, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 27, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20f8602-0acb-41bc-8cc4-999625917517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:01 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Volume volume-87bcac24-938b-4658-8267-ce6b74c90a47 (87bcac24-938b-4658-8267-ce6b74c90a47): created successfully Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20f8602-0acb-41bc-8cc4-999625917517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Flow 'volume_create_manager' (3966910f-8d44-4745-969a-cfda3d40c342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:49:01 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-6885c974-0196-46ee-8846-829f38207cdf tempest-VolumesImageMetadata-1971743537 None] Created volume successfully. Sep 23 12:49:01 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.327s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:49:01 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] Deleted volume successfully. Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-88605e0e-51ea-44c7-b4ce-3fcbf709cab4 tempest-CinderUnicodeTest-950064350 None] Lock "cinder-d73cba93-e69e-4ead-bbeb-038ef7cc74a0-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:01 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373" returned: 0 in 0.312s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:49:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28a3da6-5695-4512-b9b8-288634f22a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be5cc67-bbd9-44d9-8913-62fcd7932c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:02 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Volume volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 (ccb234cc-04a0-4bd0-ba0b-dbcdfee79373): created successfully Sep 23 12:49:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be5cc67-bbd9-44d9-8913-62fcd7932c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Flow 'volume_create_manager' (16f5e156-f548-48f5-81b8-3f41d11a80c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:49:02 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-af15fcd3-5f28-4fdd-8bc9-8798bead5436 tempest-SnapshotDependencyTests-45579548 None] Created volume successfully. Sep 23 12:49:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] Acquiring lock "cinder-87bcac24-938b-4658-8267-ce6b74c90a47-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] Lock "cinder-87bcac24-938b-4658-8267-ce6b74c90a47-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] Acquiring lock "cinder-quobyte-87bcac24-938b-4658-8267-ce6b74c90a47" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] Lock "cinder-quobyte-87bcac24-938b-4658-8267-ce6b74c90a47" acquired by "delete_volume" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:02 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b40fc2b-2533-467b-94b8-3754e58659d4]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-87bcac24-938b-4658-8267-ce6b74c90a47 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:03 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-87bcac24-938b-4658-8267-ce6b74c90a47 Sep 23 12:49:03 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9cf2fe9b-9653-4d01-9442-630794a2caaf tempest-SnapshotDependencyTests-45579548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9cf2fe9b-9653-4d01-9442-630794a2caaf tempest-SnapshotDependencyTests-45579548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-9cf2fe9b-9653-4d01-9442-630794a2caaf tempest-SnapshotDependencyTests-45579548 None] Creating offline snapshot 57ef29be-f05d-40f7-9d42-4d81545efc34 of volume ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:49:03 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f69ffa-c6c7-4e24-b890-e92003f1021c]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9cf2fe9b-9653-4d01-9442-630794a2caaf tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:03 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-87bcac24-938b-4658-8267-ce6b74c90a47" returned: 0 in 0.585s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-87bcac24-938b-4658-8267-ce6b74c90a47 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:03 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 Sep 23 12:49:03 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:03 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-87bcac24-938b-4658-8267-ce6b74c90a47 Sep 23 12:49:03 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:03 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-87bcac24-938b-4658-8267-ce6b74c90a47" returned: 0 in 0.397s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] Lock "cinder-quobyte-87bcac24-938b-4658-8267-ce6b74c90a47" released by "delete_volume" :: held 1.051s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:03 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9cf2fe9b-9653-4d01-9442-630794a2caaf tempest-SnapshotDependencyTests-45579548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373" returned: 0 in 0.541s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9cf2fe9b-9653-4d01-9442-630794a2caaf tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:04 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34 1G Sep 23 12:49:04 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:04 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] Created reservations ['564832fe-e17e-4482-8983-a59c2b5634c0', '984b05ff-4e00-4d1a-9007-cf0ae047d739', '24a4d292-f906-4d2c-86d9-00126ca52f55', '80d8343a-13a4-42c5-8641-bd4603d6a013'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:49:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:04 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:49:04 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:04 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9cf2fe9b-9653-4d01-9442-630794a2caaf tempest-SnapshotDependencyTests-45579548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34 1G" returned: 0 in 0.608s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9cf2fe9b-9653-4d01-9442-630794a2caaf tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:04 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:04 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34 Sep 23 12:49:04 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.407s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:04 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:49:04 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] Deleted volume successfully. Sep 23 12:49:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-782d29d4-719e-4f89-9ff6-4809bf282c03 tempest-VolumesImageMetadata-1971743537 None] Lock "cinder-87bcac24-938b-4658-8267-ce6b74c90a47-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:04 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9cf2fe9b-9653-4d01-9442-630794a2caaf tempest-SnapshotDependencyTests-45579548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34" returned: 0 in 0.378s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:04 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-9cf2fe9b-9653-4d01-9442-630794a2caaf tempest-SnapshotDependencyTests-45579548 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34 is being set with open permissions: ugo+rw Sep 23 12:49:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9cf2fe9b-9653-4d01-9442-630794a2caaf tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:04 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34 Sep 23 12:49:04 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:05 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9cf2fe9b-9653-4d01-9442-630794a2caaf tempest-SnapshotDependencyTests-45579548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34" returned: 0 in 0.300s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9cf2fe9b-9653-4d01-9442-630794a2caaf tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:05 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.info Sep 23 12:49:05 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:05 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9cf2fe9b-9653-4d01-9442-630794a2caaf tempest-SnapshotDependencyTests-45579548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.info" returned: 0 in 0.288s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:05 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-9cf2fe9b-9653-4d01-9442-630794a2caaf tempest-SnapshotDependencyTests-45579548 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.info is being set with open permissions: ugo+rw Sep 23 12:49:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9cf2fe9b-9653-4d01-9442-630794a2caaf tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:05 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.info Sep 23 12:49:05 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:05 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9cf2fe9b-9653-4d01-9442-630794a2caaf tempest-SnapshotDependencyTests-45579548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.info" returned: 0 in 0.301s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9cf2fe9b-9653-4d01-9442-630794a2caaf tempest-SnapshotDependencyTests-45579548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.541s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:05 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-9cf2fe9b-9653-4d01-9442-630794a2caaf tempest-SnapshotDependencyTests-45579548 None] Create snapshot completed successfully Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Flow 'volume_create_manager' (381c0763-8967-4972-a642-cd62f4800093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee3e1ca-43af-4d51-9c08-11923d531d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee3e1ca-43af-4d51-9c08-11923d531d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9c23299122439b853fc7c38c893dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=57ef29be-f05d-40f7-9d42-4d81545efc34,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:49:07Z,use_quota=True,user_id='0f58a6fd0f954553b4e671d8dfca2f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09e2165-0eb0-4528-bd59-cadc7670129c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09e2165-0eb0-4528-bd59-cadc7670129c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ad05b5-5c85-4d51-9c8f-799de26d3b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ad05b5-5c85-4d51-9c8f-799de26d3b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1', 'volume_name': 'volume-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1', 'volume_size': 1, 'snapshot_id': '57ef29be-f05d-40f7-9d42-4d81545efc34'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4fec09-7d7c-43b3-9418-1af8ff41fb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4fec09-7d7c-43b3-9418-1af8ff41fb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e75625c-dae1-462f-8e57-12c674279a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:07 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Volume 268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1', 'volume_size': 1, 'snapshot_id': '57ef29be-f05d-40f7-9d42-4d81545efc34'} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Acquiring lock "cinder-quobyte-57ef29be-f05d-40f7-9d42-4d81545efc34-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1" by "_create_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Lock "cinder-quobyte-57ef29be-f05d-40f7-9d42-4d81545efc34-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Creating volume 268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1 from snapshot 57ef29be-f05d-40f7-9d42-4d81545efc34 {{(pid=86085) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Acquiring lock "cinder-quobyte-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1" by "_copy_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Lock "cinder-quobyte-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] snapshot: 57ef29be-f05d-40f7-9d42-4d81545efc34, volume: 268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1, {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9121375-4aec-44a2-8349-96708d1d3789]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:07 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34 Sep 23 12:49:07 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:07 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34" returned: 0 in 0.392s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ef7551-077f-43f2-8743-f7e081f422e5]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:08 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 Sep 23 12:49:08 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:08 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373" returned: 0 in 0.420s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:08 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] will copy from snapshot at /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 12:49:08 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Creating direct copy from snapshot {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 12:49:08 devstack cinder-volume[86085]: DEBUG cinder.utils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Path /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1 not found in is_blk_device check {{(pid=86085) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 12:49:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:08 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1 Sep 23 12:49:08 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:10 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:49:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Flow 'volume_create_manager' (bde69b7f-e3ed-4e07-9392-5c1bc4074dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:49:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89622404-bb06-49ad-836b-b53dce7e008d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89622404-bb06-49ad-836b-b53dce7e008d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2092175189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cd5e19b-0341-4ed1-bb12-8185f6d4c220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1044c2bc3845da95deb6dc98319b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:49:10Z,use_quota=True,user_id='223f8f0d21014a729c6160f76bd9eeaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d83482-647d-4d69-bb76-d0efd1c1e9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d83482-647d-4d69-bb76-d0efd1c1e9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bacf513-d7da-4603-95db-f49a07519ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bacf513-d7da-4603-95db-f49a07519ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cd5e19b-0341-4ed1-bb12-8185f6d4c220', 'volume_name': 'volume-8cd5e19b-0341-4ed1-bb12-8185f6d4c220', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (339c3ab5-1648-4dcc-a81c-29e88ed2a2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (339c3ab5-1648-4dcc-a81c-29e88ed2a2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:10 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4b98a7-1ce5-4d0d-a568-4de54f0d986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:10 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Volume 8cd5e19b-0341-4ed1-bb12-8185f6d4c220: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cd5e19b-0341-4ed1-bb12-8185f6d4c220', 'volume_size': 1} Sep 23 12:49:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:16 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1" returned: 0 in 8.111s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Image conversion details: src /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373, size 1024.00 MB, duration 8.11 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1 {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:49:16 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Converted 1024.00 MB image at 126.23 MB/s Sep 23 12:49:16 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1 is being set with open permissions: ugo+rw Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:16 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1 Sep 23 12:49:16 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:16 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1" returned: 0 in 0.246s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Lock "cinder-quobyte-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1" released by "_copy_volume_from_snapshot" :: held 9.273s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=108,cinder:UPDATE=140,cinder:INSERT=41,cinder:DELETE=10 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=114,cinder:INSERT=40,cinder:UPDATE=142,cinder:DELETE=15 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Lock "cinder-quobyte-57ef29be-f05d-40f7-9d42-4d81545efc34-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1" released by "_create_volume_from_snapshot" :: held 9.353s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.371s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.340s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2092175189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cd5e19b-0341-4ed1-bb12-8185f6d4c220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1044c2bc3845da95deb6dc98319b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:49:10Z,use_quota=True,user_id='223f8f0d21014a729c6160f76bd9eeaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Creating volume 8cd5e19b-0341-4ed1-bb12-8185f6d4c220 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:49:16 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8cd5e19b-0341-4ed1-bb12-8185f6d4c220 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:16 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8cd5e19b-0341-4ed1-bb12-8185f6d4c220 1073741824 Sep 23 12:49:16 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e75625c-dae1-462f-8e57-12c674279a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1', 'volume_size': 1, 'snapshot_id': '57ef29be-f05d-40f7-9d42-4d81545efc34'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dff161d-585d-42fc-badf-d55d4c897bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:16 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Volume volume-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1 (268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1): created successfully Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dff161d-585d-42fc-badf-d55d4c897bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Flow 'volume_create_manager' (381c0763-8967-4972-a642-cd62f4800093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:49:16 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0a2a8281-f3e1-431c-97e3-4f6c59f69a5d tempest-SnapshotDependencyTests-45579548 None] Created volume successfully. Sep 23 12:49:17 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8cd5e19b-0341-4ed1-bb12-8185f6d4c220 1073741824" returned: 0 in 0.525s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8cd5e19b-0341-4ed1-bb12-8185f6d4c220 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] Acquiring lock "cinder-57ef29be-f05d-40f7-9d42-4d81545efc34-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:17 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8cd5e19b-0341-4ed1-bb12-8185f6d4c220 Sep 23 12:49:17 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] Lock "cinder-57ef29be-f05d-40f7-9d42-4d81545efc34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] Acquiring lock "cinder-quobyte-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] Lock "cinder-quobyte-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] Acquiring lock "cinder-quobyte-57ef29be-f05d-40f7-9d42-4d81545efc34" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] Lock "cinder-quobyte-57ef29be-f05d-40f7-9d42-4d81545efc34" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] Deleting offline snapshot 57ef29be-f05d-40f7-9d42-4d81545efc34 of volume ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] snapshot_file for this snap is: volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b4b7e9-a942-4400-8636-020d10151301]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:17 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34 Sep 23 12:49:17 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:17 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8cd5e19b-0341-4ed1-bb12-8185f6d4c220" returned: 0 in 0.314s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4b98a7-1ce5-4d0d-a568-4de54f0d986c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cd5e19b-0341-4ed1-bb12-8185f6d4c220', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed05eedf-ed65-4e26-a031-aaa70104d862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:17 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Volume volume-8cd5e19b-0341-4ed1-bb12-8185f6d4c220 (8cd5e19b-0341-4ed1-bb12-8185f6d4c220): created successfully Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed05eedf-ed65-4e26-a031-aaa70104d862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Flow 'volume_create_manager' (bde69b7f-e3ed-4e07-9392-5c1bc4074dae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:49:17 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-602f65e5-e7a8-4976-9a19-4e114cf88afd tempest-VolumesMetadataTest-312809744 None] Created volume successfully. Sep 23 12:49:17 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34" returned: 0 in 0.409s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[966794fa-a664-4dc9-8490-b2f1da8be930]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:18 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 Sep 23 12:49:18 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:18 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373" returned: 0 in 0.562s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:18 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34 Sep 23 12:49:18 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:18 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34" returned: 0 in 0.371s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:18 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34 Sep 23 12:49:18 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:19 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373.57ef29be-f05d-40f7-9d42-4d81545efc34" returned: 0 in 0.310s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] Lock "cinder-quobyte-57ef29be-f05d-40f7-9d42-4d81545efc34" released by "_delete_snapshot" :: held 1.802s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] Lock "cinder-quobyte-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373" released by "delete_snapshot" :: held 1.834s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Flow 'volume_create_manager' (0f4687f7-db23-44bc-a62e-b83e39c0422c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762d57ae-de13-43e4-80c4-647ad4b3c0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762d57ae-de13-43e4-80c4-647ad4b3c0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ed03fa-308d-4ea7-8bf4-64ff08e121fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db355dd832854969b8d510d31289cb53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:49:19Z,use_quota=True,user_id='ee6a495ae56043e1ad284eab5f82613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec947ffa-acc3-43de-94b3-d9bee721a7c6),volume_type_id=ec947ffa-acc3-43de-94b3-d9bee721a7c6)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e8366b-8a76-46e2-b8fd-81cd1e4c7a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e8366b-8a76-46e2-b8fd-81cd1e4c7a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9b97f2-1e59-4b56-86ae-e990f0a05bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.image.glance [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Creating Keystone auth plugin from conf {{(pid=86085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] Created reservations ['de21b5e6-73e7-4cde-ab6f-e04ca8c88725', 'c7b43fc2-9298-4413-84c9-9fb27dc3bcf0', 'dc399298-bb03-422c-ad82-e2e239439ee5', '48d0bcd3-6f9e-4e42-b269-782131516e26'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:49:19 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] Delete snapshot completed successfully. Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3bc665ae-7c08-40f2-86ee-ef602fd02984 tempest-SnapshotDependencyTests-45579548 None] Lock "cinder-57ef29be-f05d-40f7-9d42-4d81545efc34-delete_snapshot" released by "delete_snapshot" :: held 2.096s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] Acquiring lock "cinder-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] Lock "cinder-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] Acquiring lock "cinder-8cd5e19b-0341-4ed1-bb12-8185f6d4c220-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] Acquiring lock "cinder-quobyte-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] Lock "cinder-8cd5e19b-0341-4ed1-bb12-8185f6d4c220-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] Lock "cinder-quobyte-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373" acquired by "delete_volume" :: waited 0.031s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9b97f2-1e59-4b56-86ae-e990f0a05bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f5ed03fa-308d-4ea7-8bf4-64ff08e121fb', 'volume_name': 'volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb', 'volume_size': 1, 'image_id': '96e09fe4-24f8-4e6c-9a68-5c8a19166676', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/96e09fe4-24f8-4e6c-9a68-5c8a19166676', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1cfadac94b22bfed7444b6d826c148c1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'db355dd832854969b8d510d31289cb53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7c302a1fd6dd0a4175a152331e9d5c0bb547f21f9412dad5cf8cd9a50502028ebeae5b2ccd09fc337ec9b4e3c8b27d74e11a6b79c9fafbc0b956df0e803a0270', 'id': '96e09fe4-24f8-4e6c-9a68-5c8a19166676', 'created_at': datetime.datetime(2026, 9, 23, 10, 49, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 49, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/96e09fe4-24f8-4e6c-9a68-5c8a19166676/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6e4038-01f9-4866-be29-2d8754615a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6e4038-01f9-4866-be29-2d8754615a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cffaa64-55e4-421b-adbe-94801ddbfa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:19 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Volume f5ed03fa-308d-4ea7-8bf4-64ff08e121fb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb', 'volume_size': 1, 'image_id': '96e09fe4-24f8-4e6c-9a68-5c8a19166676', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/96e09fe4-24f8-4e6c-9a68-5c8a19166676', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1cfadac94b22bfed7444b6d826c148c1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'db355dd832854969b8d510d31289cb53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7c302a1fd6dd0a4175a152331e9d5c0bb547f21f9412dad5cf8cd9a50502028ebeae5b2ccd09fc337ec9b4e3c8b27d74e11a6b79c9fafbc0b956df0e803a0270', 'id': '96e09fe4-24f8-4e6c-9a68-5c8a19166676', 'created_at': datetime.datetime(2026, 9, 23, 10, 49, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 49, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/96e09fe4-24f8-4e6c-9a68-5c8a19166676/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Trying to clone f5ed03fa-308d-4ea7-8bf4-64ff08e121fb from image 96e09fe4-24f8-4e6c-9a68-5c8a19166676 at location (None, [{'url': 'file:///opt/stack/data/glance/images/96e09fe4-24f8-4e6c-9a68-5c8a19166676', 'metadata': {}}]). {{(pid=86085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[21da3365-6044-4dab-805c-def5be027e7f]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] Acquiring lock "cinder-quobyte-8cd5e19b-0341-4ed1-bb12-8185f6d4c220" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] Lock "cinder-quobyte-8cd5e19b-0341-4ed1-bb12-8185f6d4c220" acquired by "delete_volume" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 12:49:19 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Image download 0.00 MB at 0.00 MB/s Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25ee033-5fcc-4bf3-b104-7d6d09339f19]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8cd5e19b-0341-4ed1-bb12-8185f6d4c220 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:19 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 Sep 23 12:49:19 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[baba0a7c-b759-4b5e-81d8-733482d40fcd]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:20 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8cd5e19b-0341-4ed1-bb12-8185f6d4c220 Sep 23 12:49:20 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:20 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD Sep 23 12:49:20 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:20 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373" returned: 0 in 0.442s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:20 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373 Sep 23 12:49:20 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:20 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:20 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8cd5e19b-0341-4ed1-bb12-8185f6d4c220" returned: 0 in 0.408s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8cd5e19b-0341-4ed1-bb12-8185f6d4c220 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:20 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8cd5e19b-0341-4ed1-bb12-8185f6d4c220 Sep 23 12:49:20 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:20 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD Sep 23 12:49:20 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:20 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373" returned: 0 in 0.257s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] Lock "cinder-quobyte-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373" released by "delete_volume" :: held 0.794s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] Created reservations ['a19d45b5-c9c1-45f4-8e74-ced03ad30408', 'd34f563c-2f51-4bd6-8103-0e329203412c', '3af6cc23-6e89-4293-94e7-d30cb5e98cca', 'f4615c15-9c30-458e-9e9e-268f868c9bd6'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:49:20 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8cd5e19b-0341-4ed1-bb12-8185f6d4c220" returned: 0 in 0.280s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] Lock "cinder-quobyte-8cd5e19b-0341-4ed1-bb12-8185f6d4c220" released by "delete_volume" :: held 0.754s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:20 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Temporary image 96e09fe4-24f8-4e6c-9a68-5c8a19166676 is fetched for user ee6a495ae56043e1ad284eab5f82613b. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:20 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:49:20 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] Created reservations ['14ccfa2b-9adc-4e28-8ba2-21d9b165c89b', 'eb336801-9a73-4013-9545-a06259f77b24', '132f8b06-967d-4d8c-a4dc-31efcb50de59', 'a99141f9-675e-4d32-8d0f-10183765ca2f'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0c25b5-4a97-413e-bfbe-34b79b49deca]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] Acquiring lock "cinder-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] Lock "cinder-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:20 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:49:20 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] Acquiring lock "cinder-quobyte-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] Lock "cinder-quobyte-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1" acquired by "delete_volume" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:20 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD Sep 23 12:49:20 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f6e114-3fda-4446-85e5-216ac642cc66]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:21 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.415s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:49:21 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] Deleted volume successfully. Sep 23 12:49:21 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1 Sep 23 12:49:21 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e56b4712-7e3f-4397-8bed-d53762978cf0 tempest-SnapshotDependencyTests-45579548 None] Lock "cinder-ccb234cc-04a0-4bd0-ba0b-dbcdfee79373-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:21 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.347s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:49:21 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] Deleted volume successfully. Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-60ff7f6d-68e3-46f8-9293-ec5012b07821 tempest-VolumesMetadataTest-312809744 None] Lock "cinder-8cd5e19b-0341-4ed1-bb12-8185f6d4c220-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:21 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD" returned: 0 in 0.546s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:21 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD Sep 23 12:49:21 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:21 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1" returned: 0 in 0.448s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:21 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1 Sep 23 12:49:21 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:21 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ed03fa-308d-4ea7-8bf4-64ff08e121fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db355dd832854969b8d510d31289cb53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:49:19Z,use_quota=True,user_id='ee6a495ae56043e1ad284eab5f82613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec947ffa-acc3-43de-94b3-d9bee721a7c6),volume_type_id=ec947ffa-acc3-43de-94b3-d9bee721a7c6)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Creating volume f5ed03fa-308d-4ea7-8bf4-64ff08e121fb {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:49:21 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:21 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb 1073741824 Sep 23 12:49:21 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:21 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1" returned: 0 in 0.269s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] Lock "cinder-quobyte-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1" released by "delete_volume" :: held 0.800s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] Created reservations ['6d4c5b11-850e-4260-9a89-0d4dd823dcc1', '01c88e61-e1df-44b4-b3e3-aaecda8e95d6', '28b1fc4a-901f-4a4e-950c-402288f03806', '6e761be4-f5ba-4ba0-9c8c-bc1666d597c4'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:21 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:49:21 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:22 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.422s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:22 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:49:22 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] Deleted volume successfully. Sep 23 12:49:22 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb 1073741824" returned: 0 in 0.679s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-2e3630a7-6462-44aa-953b-56aac6fcd257 tempest-SnapshotDependencyTests-45579548 None] Lock "cinder-268d5955-a2cc-4dea-bf64-bd5fd7ae1bb1-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:22 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb Sep 23 12:49:22 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:22 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb" returned: 0 in 0.299s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:49:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:22 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Attempting download of 96e09fe4-24f8-4e6c-9a68-5c8a19166676 ((None, [{'url': 'file:///opt/stack/data/glance/images/96e09fe4-24f8-4e6c-9a68-5c8a19166676', 'metadata': {}}])) to volume f5ed03fa-308d-4ea7-8bf4-64ff08e121fb. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 12:49:22 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[88104e4d-3dc9-41e5-9043-3a8c5e91aabf]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_96e09fe4-24f8-4e6c-9a68-5c8a19166676_tryeqxog {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:22 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_96e09fe4-24f8-4e6c-9a68-5c8a19166676_tryeqxog Sep 23 12:49:22 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:23 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_96e09fe4-24f8-4e6c-9a68-5c8a19166676_tryeqxog" returned: 0 in 0.368s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_96e09fe4-24f8-4e6c-9a68-5c8a19166676_tryeqxog {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:23 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_96e09fe4-24f8-4e6c-9a68-5c8a19166676_tryeqxog Sep 23 12:49:23 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:23 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_96e09fe4-24f8-4e6c-9a68-5c8a19166676_tryeqxog" returned: 1 in 0.384s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_96e09fe4-24f8-4e6c-9a68-5c8a19166676_tryeqxog' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:49:23 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8c32f7-0552-4cda-b32e-0f6e31485c8f]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:23 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD Sep 23 12:49:23 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:23 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:24 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD Sep 23 12:49:24 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:24 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD" returned: 1 in 0.386s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:49:24 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] 96e09fe4-24f8-4e6c-9a68-5c8a19166676 was raw, converting to qcow2 {{(pid=86085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 12:49:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:24 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb Sep 23 12:49:24 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:24 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb" returned: 0 in 0.577s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:24 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_96e09fe4-24f8-4e6c-9a68-5c8a19166676_2_wz5aocdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:49:24 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 12:49:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:24 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb 1G Sep 23 12:49:24 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:25 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb 1G" returned: 0 in 0.383s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Downloaded image 96e09fe4-24f8-4e6c-9a68-5c8a19166676 ((None, [{'url': 'file:///opt/stack/data/glance/images/96e09fe4-24f8-4e6c-9a68-5c8a19166676', 'metadata': {}}])) to volume f5ed03fa-308d-4ea7-8bf4-64ff08e121fb successfully. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Temporary image 96e09fe4-24f8-4e6c-9a68-5c8a19166676 for user ee6a495ae56043e1ad284eab5f82613b is deleted. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Marking volume f5ed03fa-308d-4ea7-8bf4-64ff08e121fb as bootable. {{(pid=86085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Copying metadata from image 96e09fe4-24f8-4e6c-9a68-5c8a19166676 to f5ed03fa-308d-4ea7-8bf4-64ff08e121fb. {{(pid=86085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Creating volume glance metadata for volume f5ed03fa-308d-4ea7-8bf4-64ff08e121fb backed by image 96e09fe4-24f8-4e6c-9a68-5c8a19166676 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '96e09fe4-24f8-4e6c-9a68-5c8a19166676', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1cfadac94b22bfed7444b6d826c148c1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cffaa64-55e4-421b-adbe-94801ddbfa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb', 'volume_size': 1, 'image_id': '96e09fe4-24f8-4e6c-9a68-5c8a19166676', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/96e09fe4-24f8-4e6c-9a68-5c8a19166676', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1cfadac94b22bfed7444b6d826c148c1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'db355dd832854969b8d510d31289cb53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7c302a1fd6dd0a4175a152331e9d5c0bb547f21f9412dad5cf8cd9a50502028ebeae5b2ccd09fc337ec9b4e3c8b27d74e11a6b79c9fafbc0b956df0e803a0270', 'id': '96e09fe4-24f8-4e6c-9a68-5c8a19166676', 'created_at': datetime.datetime(2026, 9, 23, 10, 49, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 49, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/96e09fe4-24f8-4e6c-9a68-5c8a19166676/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3320fb-1a1b-4aee-999a-731d52ee5f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Flow 'volume_create_manager' (f02b556e-b1f4-4820-9cb7-b9ce3f227310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0207fc2f-2fd7-4242-afda-5b8b9be5af92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:25 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Volume volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb (f5ed03fa-308d-4ea7-8bf4-64ff08e121fb): created successfully Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3320fb-1a1b-4aee-999a-731d52ee5f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Flow 'volume_create_manager' (0f4687f7-db23-44bc-a62e-b83e39c0422c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0207fc2f-2fd7-4242-afda-5b8b9be5af92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1157327820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02dd5d9-2fa2-4cda-a928-814dc7683b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce3f8791a2d4584876a42a48bc222e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:49:25Z,use_quota=True,user_id='1cb169bca5c14cabaffb9cdb0accfb5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e6ecd6-aa76-4a29-ace6-b36d38108797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e6ecd6-aa76-4a29-ace6-b36d38108797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd066b2-5fd8-4149-9fba-50d7eac9d1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.image.glance [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Creating Keystone auth plugin from conf {{(pid=86085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 12:49:25 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-a3cfd8f0-ed1b-491d-953f-79e780b4d782 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Created volume successfully. Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Acquiring lock "cinder-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Lock "cinder-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd066b2-5fd8-4149-9fba-50d7eac9d1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a02dd5d9-2fa2-4cda-a928-814dc7683b7f', 'volume_name': 'volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f', 'volume_size': 1, 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3c5121b794a4715babb77a8b7da12a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'created_at': datetime.datetime(2026, 9, 23, 10, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 27, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ba9f43-4968-45b4-88cc-c0b63f0f750e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ba9f43-4968-45b4-88cc-c0b63f0f750e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f437ed7-dfe5-4fcd-804a-22ef27415f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:25 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Volume a02dd5d9-2fa2-4cda-a928-814dc7683b7f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f', 'volume_size': 1, 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3c5121b794a4715babb77a8b7da12a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'created_at': datetime.datetime(2026, 9, 23, 10, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 27, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Trying to clone a02dd5d9-2fa2-4cda-a928-814dc7683b7f from image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]). {{(pid=86085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Acquiring lock "cinder-quobyte-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Lock "cinder-quobyte-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb" acquired by "delete_volume" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a0e4ca-f132-4f90-9f50-8740f611b00d]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:26 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb Sep 23 12:49:26 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:26 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_o1l_sk7edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 12:49:26 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Image download 20.69 MB at 20.69 MB/s Sep 23 12:49:26 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc88da7c-6827-4e22-83f5-d05e2c9b6181]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_o1l_sk7edevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:26 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_o1l_sk7edevstack@QuobyteHD Sep 23 12:49:26 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:26 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb" returned: 0 in 0.541s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:26 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb Sep 23 12:49:26 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:26 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_o1l_sk7edevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:26 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Temporary image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 is fetched for user 1cb169bca5c14cabaffb9cdb0accfb5e. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 12:49:26 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[753d627a-2b62-48d5-ad1b-6f048b489504]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_o1l_sk7edevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:26 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb" returned: 0 in 0.287s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Lock "cinder-quobyte-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb" released by "delete_volume" :: held 0.906s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:26 devstack cinder-volume[86085]: WARNING cinder.quota [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:49:26 devstack cinder-volume[86085]: WARNING cinder.quota [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 23 12:49:26 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Created reservations ['93baed58-0121-4dba-a7b7-76565a727269', 'dfeccbca-be54-4f0a-8268-7dbc73a2fddd', '2df2bcab-3c15-4faa-a6a5-502c45d02eec', 'b42280ca-e8ec-4d00-abf3-3e0e52fe4820'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:49:26 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_o1l_sk7edevstack@QuobyteHD Sep 23 12:49:26 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:26 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:49:26 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:27 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_o1l_sk7edevstack@QuobyteHD" returned: 0 in 0.487s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1157327820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02dd5d9-2fa2-4cda-a928-814dc7683b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce3f8791a2d4584876a42a48bc222e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:49:25Z,use_quota=True,user_id='1cb169bca5c14cabaffb9cdb0accfb5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:49:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Creating volume a02dd5d9-2fa2-4cda-a928-814dc7683b7f {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:49:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:49:27 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:49:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:27 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.328s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:27 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:49:27 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Deleted volume successfully. Sep 23 12:49:27 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f 1073741824 Sep 23 12:49:27 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-bb869823-911c-414f-8dcf-682213794d67 tempest-VolumeAndVolumeTypeFromImageTest-955760022 None] Lock "cinder-f5ed03fa-308d-4ea7-8bf4-64ff08e121fb-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:27 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f 1073741824" returned: 0 in 0.452s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:27 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f Sep 23 12:49:27 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:28 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f" returned: 0 in 0.278s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:28 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:49:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:28 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Attempting download of 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}])) to volume a02dd5d9-2fa2-4cda-a928-814dc7683b7f. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 12:49:28 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6426c46c-c1c5-48ba-9b2f-99a4c50002e3]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_d7xu81m4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:28 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_d7xu81m4 Sep 23 12:49:28 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:28 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_d7xu81m4" returned: 0 in 0.369s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_d7xu81m4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:28 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_d7xu81m4 Sep 23 12:49:28 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:28 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_d7xu81m4" returned: 1 in 0.398s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_d7xu81m4' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:49:28 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e96f1ec-68b5-4143-8dd2-bde3f0874840]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_o1l_sk7edevstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:29 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_o1l_sk7edevstack@QuobyteHD Sep 23 12:49:29 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:29 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_o1l_sk7edevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:29 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 was qcow2, converting to qcow2 {{(pid=86085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 12:49:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_o1l_sk7edevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:29 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_o1l_sk7edevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f Sep 23 12:49:29 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:31 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_o1l_sk7edevstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f" returned: 0 in 2.413s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:31 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d11a2ba-6f6c-4536-aca7-4e5314d428b2_o1l_sk7edevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:49:31 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Converted 112.00 MB image at 46.39 MB/s Sep 23 12:49:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:31 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f 1G Sep 23 12:49:31 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:32 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f 1G" returned: 0 in 0.403s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:32 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Downloaded image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}])) to volume a02dd5d9-2fa2-4cda-a928-814dc7683b7f successfully. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 12:49:32 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Temporary image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 for user 1cb169bca5c14cabaffb9cdb0accfb5e is deleted. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 12:49:32 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Marking volume a02dd5d9-2fa2-4cda-a928-814dc7683b7f as bootable. {{(pid=86085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 12:49:32 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Copying metadata from image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 to a02dd5d9-2fa2-4cda-a928-814dc7683b7f. {{(pid=86085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 12:49:32 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Creating volume glance metadata for volume a02dd5d9-2fa2-4cda-a928-814dc7683b7f backed by image 9d11a2ba-6f6c-4536-aca7-4e5314d428b2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 12:49:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f437ed7-dfe5-4fcd-804a-22ef27415f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f', 'volume_size': 1, 'image_id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3c5121b794a4715babb77a8b7da12a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d11a2ba-6f6c-4536-aca7-4e5314d428b2', 'created_at': datetime.datetime(2026, 9, 23, 10, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 27, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d11a2ba-6f6c-4536-aca7-4e5314d428b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbfb9dda-0f98-48be-a137-31c7b9911bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:32 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Volume volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f (a02dd5d9-2fa2-4cda-a928-814dc7683b7f): created successfully Sep 23 12:49:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbfb9dda-0f98-48be-a137-31c7b9911bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:32 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Flow 'volume_create_manager' (f02b556e-b1f4-4820-9cb7-b9ce3f227310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:49:32 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-c5a24b0e-b955-46aa-b7e8-e04cde073e49 tempest-VolumesExtendTest-354146542 None] Created volume successfully. Sep 23 12:49:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1065791d-0b01-4abb-a47c-2f0e2baa0ab5 tempest-VolumesExtendTest-354146542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1065791d-0b01-4abb-a47c-2f0e2baa0ab5 tempest-VolumesExtendTest-354146542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:33 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[4476b88b-2c5b-42e9-89ee-d85dc356584a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1065791d-0b01-4abb-a47c-2f0e2baa0ab5 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:33 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f Sep 23 12:49:33 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:33 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1065791d-0b01-4abb-a47c-2f0e2baa0ab5 tempest-VolumesExtendTest-354146542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f" returned: 0 in 0.432s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1065791d-0b01-4abb-a47c-2f0e2baa0ab5 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f 2G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1065791d-0b01-4abb-a47c-2f0e2baa0ab5 tempest-VolumesExtendTest-354146542 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f 2G" returned: 0 in 0.126s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1065791d-0b01-4abb-a47c-2f0e2baa0ab5 tempest-VolumesExtendTest-354146542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.595s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:33 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-1065791d-0b01-4abb-a47c-2f0e2baa0ab5 tempest-VolumesExtendTest-354146542 None] Extend volume completed successfully. Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Flow 'volume_create_manager' (cfda8ab5-e6ad-49fb-9b95-3f80f14fa943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306a1ee4-d250-4a1e-8688-3c44c334a896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306a1ee4-d250-4a1e-8688-3c44c334a896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2007364494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='118a22bade1449e3861f0d428922e1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:49:34Z,use_quota=True,user_id='b1e82bbebcd344b7b8c79075b3561f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a0ee36-95dc-44fb-84d5-050fcc58a107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a0ee36-95dc-44fb-84d5-050fcc58a107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df200cd0-3575-41c5-ab30-fa337f92296b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df200cd0-3575-41c5-ab30-fa337f92296b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51', 'volume_name': 'volume-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f000732-ba2f-4b71-a1ea-773c5f8c6bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f000732-ba2f-4b71-a1ea-773c5f8c6bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (728f29a6-2cac-4e38-b0ac-973b2bca1c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:34 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Volume 6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51', 'volume_size': 1} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2007364494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='118a22bade1449e3861f0d428922e1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:49:34Z,use_quota=True,user_id='b1e82bbebcd344b7b8c79075b3561f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Creating volume 6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:49:34 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:34 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51 1073741824 Sep 23 12:49:34 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] Acquiring lock "cinder-a02dd5d9-2fa2-4cda-a928-814dc7683b7f-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] Lock "cinder-a02dd5d9-2fa2-4cda-a928-814dc7683b7f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] Acquiring lock "cinder-quobyte-a02dd5d9-2fa2-4cda-a928-814dc7683b7f" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] Lock "cinder-quobyte-a02dd5d9-2fa2-4cda-a928-814dc7683b7f" acquired by "delete_volume" :: waited 0.014s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb60f31-eb44-49be-ad0f-df12af8054a4]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:34 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51 1073741824" returned: 0 in 0.485s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:34 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f Sep 23 12:49:34 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:34 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51 Sep 23 12:49:34 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:35 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f" returned: 0 in 0.366s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:35 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51" returned: 0 in 0.253s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:35 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f Sep 23 12:49:35 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (728f29a6-2cac-4e38-b0ac-973b2bca1c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe14e1c-8329-45f3-a177-5ad472275773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:35 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Volume volume-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51 (6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51): created successfully Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe14e1c-8329-45f3-a177-5ad472275773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Flow 'volume_create_manager' (cfda8ab5-e6ad-49fb-9b95-3f80f14fa943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:49:35 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-3319b1a8-5111-44b2-87a6-6680abf1c578 tempest-ProjectReaderTests-1189794966 None] Created volume successfully. Sep 23 12:49:35 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a02dd5d9-2fa2-4cda-a928-814dc7683b7f" returned: 0 in 0.266s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] Lock "cinder-quobyte-a02dd5d9-2fa2-4cda-a928-814dc7683b7f" released by "delete_volume" :: held 0.677s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] Created reservations ['1a5a31e7-3df6-467b-b9ef-e3b6b62f9a9e', '4004df52-5f66-4917-9fa1-8b8f9eaedb42', 'e0154ce7-6ec8-4709-815d-9584676a25a6', '8ec8ac31-861b-4b36-9e3c-8ff319d5f126'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:35 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:49:35 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:35 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.256s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:49:35 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] Deleted volume successfully. Sep 23 12:49:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-180bee98-0a09-4423-b4f0-3c84fd5cb6f1 tempest-VolumesExtendTest-354146542 None] Lock "cinder-a02dd5d9-2fa2-4cda-a928-814dc7683b7f-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Flow 'volume_create_manager' (f5052b53-3838-4590-9661-02955e347be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88d7551-64cd-4507-b287-12e0876edf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88d7551-64cd-4507-b287-12e0876edf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-40759843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89c7157-fcfe-4396-940f-9732a761beb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce3f8791a2d4584876a42a48bc222e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:49:36Z,use_quota=True,user_id='1cb169bca5c14cabaffb9cdb0accfb5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e73022df-050f-47b1-84e3-9f64697b7770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e73022df-050f-47b1-84e3-9f64697b7770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bd57f4-9420-4d25-ae92-e95e05a4f2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bd57f4-9420-4d25-ae92-e95e05a4f2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f89c7157-fcfe-4396-940f-9732a761beb9', 'volume_name': 'volume-f89c7157-fcfe-4396-940f-9732a761beb9', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d962bf8-4e67-436b-bd5e-4bb05c2e1745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d962bf8-4e67-436b-bd5e-4bb05c2e1745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407a7682-ccf8-4b4e-852c-f94b55012259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:36 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Volume f89c7157-fcfe-4396-940f-9732a761beb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f89c7157-fcfe-4396-940f-9732a761beb9', 'volume_size': 1} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-40759843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89c7157-fcfe-4396-940f-9732a761beb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce3f8791a2d4584876a42a48bc222e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:49:36Z,use_quota=True,user_id='1cb169bca5c14cabaffb9cdb0accfb5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Creating volume f89c7157-fcfe-4396-940f-9732a761beb9 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:49:36 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:36 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9 1073741824 Sep 23 12:49:36 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] Acquiring lock "cinder-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] Lock "cinder-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] Acquiring lock "cinder-quobyte-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] Lock "cinder-quobyte-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51" acquired by "delete_volume" :: waited 0.013s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6c180d-5f30-49ed-8b77-9ed9f97927fc]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:36 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51 Sep 23 12:49:36 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:36 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9 1073741824" returned: 0 in 0.467s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:36 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9 Sep 23 12:49:36 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:37 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51" returned: 0 in 0.410s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:37 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51 Sep 23 12:49:37 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:37 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9" returned: 0 in 0.256s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407a7682-ccf8-4b4e-852c-f94b55012259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f89c7157-fcfe-4396-940f-9732a761beb9', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b10f91e-b777-45ef-9db7-83fddbaac76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:37 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Volume volume-f89c7157-fcfe-4396-940f-9732a761beb9 (f89c7157-fcfe-4396-940f-9732a761beb9): created successfully Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b10f91e-b777-45ef-9db7-83fddbaac76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Flow 'volume_create_manager' (f5052b53-3838-4590-9661-02955e347be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:49:37 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-55abfadc-25fa-4386-8b73-780a5a957a7b tempest-VolumesExtendTest-354146542 None] Created volume successfully. Sep 23 12:49:37 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51" returned: 0 in 0.254s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] Lock "cinder-quobyte-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51" released by "delete_volume" :: held 0.721s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] Created reservations ['72b5f8e9-6a9b-4e96-82f9-80f2f75303df', 'e3e35ea8-f362-462c-8f56-de198fda723e', '63c921bc-30d9-4e3b-9191-a7f77fa4851b', '9d61cc1e-bcbf-4cc4-842e-567c3f87d1cd'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:37 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:49:37 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8808a648-abec-4077-9d6d-ed7a9245ba4f tempest-VolumesExtendTest-354146542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8808a648-abec-4077-9d6d-ed7a9245ba4f tempest-VolumesExtendTest-354146542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-8808a648-abec-4077-9d6d-ed7a9245ba4f tempest-VolumesExtendTest-354146542 None] Creating offline snapshot 863adfb6-3bc9-4d75-95bd-bb8c676ec14a of volume f89c7157-fcfe-4396-940f-9732a761beb9 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb78b0b1-d935-42c5-b82e-e6951e236d09]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8808a648-abec-4077-9d6d-ed7a9245ba4f tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:37 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9 Sep 23 12:49:37 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:37 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.270s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:49:37 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] Deleted volume successfully. Sep 23 12:49:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3d195bf9-a128-4dac-9f42-6b83a085d277 tempest-ProjectReaderTests-1189794966 None] Lock "cinder-6a26b9cd-4b1c-44e6-b1c5-f8dbe4ccca51-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:38 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8808a648-abec-4077-9d6d-ed7a9245ba4f tempest-VolumesExtendTest-354146542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9" returned: 0 in 0.441s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8808a648-abec-4077-9d6d-ed7a9245ba4f tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:38 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a 1G Sep 23 12:49:38 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:38 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:49:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Flow 'volume_create_manager' (5d206432-bb95-4ab2-9c86-d6f77d36391b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:49:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5e6b0b-a887-4674-9394-43383d8b21fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5e6b0b-a887-4674-9394-43383d8b21fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-592674325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44bfc58a-8230-4ab5-845e-83dbfa8efa01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='118a22bade1449e3861f0d428922e1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:49:38Z,use_quota=True,user_id='b1e82bbebcd344b7b8c79075b3561f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9751979-66a8-43ce-ac96-a58dea826658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9751979-66a8-43ce-ac96-a58dea826658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94112708-2639-4399-a5d5-783faa290d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94112708-2639-4399-a5d5-783faa290d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44bfc58a-8230-4ab5-845e-83dbfa8efa01', 'volume_name': 'volume-44bfc58a-8230-4ab5-845e-83dbfa8efa01', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa7a6dee-fe87-4d88-a34a-5f981e5021af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa7a6dee-fe87-4d88-a34a-5f981e5021af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135384d7-d536-4cda-83bb-bf7e761a981e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:38 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Volume 44bfc58a-8230-4ab5-845e-83dbfa8efa01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44bfc58a-8230-4ab5-845e-83dbfa8efa01', 'volume_size': 1} Sep 23 12:49:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:38 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8808a648-abec-4077-9d6d-ed7a9245ba4f tempest-VolumesExtendTest-354146542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a 1G" returned: 0 in 0.405s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8808a648-abec-4077-9d6d-ed7a9245ba4f tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f89c7157-fcfe-4396-940f-9732a761beb9 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:38 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f89c7157-fcfe-4396-940f-9732a761beb9 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a Sep 23 12:49:38 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:38 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8808a648-abec-4077-9d6d-ed7a9245ba4f tempest-VolumesExtendTest-354146542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f89c7157-fcfe-4396-940f-9732a761beb9 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a" returned: 0 in 0.291s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:38 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-8808a648-abec-4077-9d6d-ed7a9245ba4f tempest-VolumesExtendTest-354146542 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a is being set with open permissions: ugo+rw Sep 23 12:49:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8808a648-abec-4077-9d6d-ed7a9245ba4f tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:38 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a Sep 23 12:49:38 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:38 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8808a648-abec-4077-9d6d-ed7a9245ba4f tempest-VolumesExtendTest-354146542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a" returned: 0 in 0.248s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8808a648-abec-4077-9d6d-ed7a9245ba4f tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:39 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.info Sep 23 12:49:39 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:39 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8808a648-abec-4077-9d6d-ed7a9245ba4f tempest-VolumesExtendTest-354146542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.info" returned: 0 in 0.248s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:39 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-8808a648-abec-4077-9d6d-ed7a9245ba4f tempest-VolumesExtendTest-354146542 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.info is being set with open permissions: ugo+rw Sep 23 12:49:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8808a648-abec-4077-9d6d-ed7a9245ba4f tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:39 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.info Sep 23 12:49:39 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:39 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8808a648-abec-4077-9d6d-ed7a9245ba4f tempest-VolumesExtendTest-354146542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.info" returned: 0 in 0.238s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8808a648-abec-4077-9d6d-ed7a9245ba4f tempest-VolumesExtendTest-354146542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.280s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-592674325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44bfc58a-8230-4ab5-845e-83dbfa8efa01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='118a22bade1449e3861f0d428922e1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:49:38Z,use_quota=True,user_id='b1e82bbebcd344b7b8c79075b3561f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:49:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Creating volume 44bfc58a-8230-4ab5-845e-83dbfa8efa01 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:49:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:49:39 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:49:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-44bfc58a-8230-4ab5-845e-83dbfa8efa01 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:39 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-44bfc58a-8230-4ab5-845e-83dbfa8efa01 1073741824 Sep 23 12:49:39 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:39 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-8808a648-abec-4077-9d6d-ed7a9245ba4f tempest-VolumesExtendTest-354146542 None] Create snapshot completed successfully Sep 23 12:49:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-19befda4-1345-46b9-974d-39cb99a90704 tempest-VolumesExtendTest-354146542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:39 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-44bfc58a-8230-4ab5-845e-83dbfa8efa01 1073741824" returned: 0 in 0.439s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-44bfc58a-8230-4ab5-845e-83dbfa8efa01 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:40 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-44bfc58a-8230-4ab5-845e-83dbfa8efa01 Sep 23 12:49:40 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:40 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-44bfc58a-8230-4ab5-845e-83dbfa8efa01" returned: 0 in 0.255s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:49:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-19befda4-1345-46b9-974d-39cb99a90704 tempest-VolumesExtendTest-354146542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.509s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135384d7-d536-4cda-83bb-bf7e761a981e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44bfc58a-8230-4ab5-845e-83dbfa8efa01', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095ba13b-dac8-42f8-98ac-50d285dc7ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:40 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[260e0d7c-0b3e-4fb5-9128-bfc3a85c730f]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-19befda4-1345-46b9-974d-39cb99a90704 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:40 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Volume volume-44bfc58a-8230-4ab5-845e-83dbfa8efa01 (44bfc58a-8230-4ab5-845e-83dbfa8efa01): created successfully Sep 23 12:49:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095ba13b-dac8-42f8-98ac-50d285dc7ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Flow 'volume_create_manager' (5d206432-bb95-4ab2-9c86-d6f77d36391b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:49:40 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-c27427fc-2465-47e1-a00c-3acea9004498 tempest-ProjectReaderTests-1189794966 None] Created volume successfully. Sep 23 12:49:40 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9 Sep 23 12:49:40 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:40 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-19befda4-1345-46b9-974d-39cb99a90704 tempest-VolumesExtendTest-354146542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9" returned: 0 in 0.350s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-19befda4-1345-46b9-974d-39cb99a90704 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a 2G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-19befda4-1345-46b9-974d-39cb99a90704 tempest-VolumesExtendTest-354146542 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a 2G" returned: 0 in 0.123s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-19befda4-1345-46b9-974d-39cb99a90704 tempest-VolumesExtendTest-354146542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.514s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:40 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-19befda4-1345-46b9-974d-39cb99a90704 tempest-VolumesExtendTest-354146542 None] Extend volume completed successfully. Sep 23 12:49:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] Acquiring lock "cinder-44bfc58a-8230-4ab5-845e-83dbfa8efa01-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] Lock "cinder-44bfc58a-8230-4ab5-845e-83dbfa8efa01-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] Acquiring lock "cinder-quobyte-44bfc58a-8230-4ab5-845e-83dbfa8efa01" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] Lock "cinder-quobyte-44bfc58a-8230-4ab5-845e-83dbfa8efa01" acquired by "delete_volume" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:49:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:49:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:49:41 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1b47e4-9b5a-43f4-9405-0dc94dc97e10]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-44bfc58a-8230-4ab5-845e-83dbfa8efa01 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:41 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-44bfc58a-8230-4ab5-845e-83dbfa8efa01 Sep 23 12:49:41 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:41 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-44bfc58a-8230-4ab5-845e-83dbfa8efa01" returned: 0 in 0.354s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-44bfc58a-8230-4ab5-845e-83dbfa8efa01 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:41 devstack sudo[103089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-44bfc58a-8230-4ab5-845e-83dbfa8efa01 Sep 23 12:49:41 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:41 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-44bfc58a-8230-4ab5-845e-83dbfa8efa01" returned: 0 in 0.252s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] Lock "cinder-quobyte-44bfc58a-8230-4ab5-845e-83dbfa8efa01" released by "delete_volume" :: held 0.649s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] Acquiring lock "cinder-863adfb6-3bc9-4d75-95bd-bb8c676ec14a-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] Created reservations ['39324d1c-1198-4621-85b2-afcc6517365c', 'cf11f90e-6295-4aff-ba0f-609dbb052b71', '412020cb-38b6-43ca-8fe8-5411c17e6806', 'fac77be4-9c00-4107-965a-9015f5498924'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] Lock "cinder-863adfb6-3bc9-4d75-95bd-bb8c676ec14a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] Acquiring lock "cinder-quobyte-f89c7157-fcfe-4396-940f-9732a761beb9" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] Lock "cinder-quobyte-f89c7157-fcfe-4396-940f-9732a761beb9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] Acquiring lock "cinder-quobyte-863adfb6-3bc9-4d75-95bd-bb8c676ec14a" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] Lock "cinder-quobyte-863adfb6-3bc9-4d75-95bd-bb8c676ec14a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] Deleting offline snapshot 863adfb6-3bc9-4d75-95bd-bb8c676ec14a of volume f89c7157-fcfe-4396-940f-9732a761beb9 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] snapshot_file for this snap is: volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b9fe45-faec-484b-a67d-0130f0559bb7]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:42 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:49:42 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:42 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a Sep 23 12:49:42 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:42 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.264s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:49:42 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] Deleted volume successfully. Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-affd07c9-4f83-4239-8a11-97a28549bff9 tempest-ProjectReaderTests-1189794966 None] Lock "cinder-44bfc58a-8230-4ab5-845e-83dbfa8efa01-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:42 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a" returned: 0 in 0.413s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f89c7157-fcfe-4396-940f-9732a761beb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d00064-835b-4787-948d-ead762fe713a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:42 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9 Sep 23 12:49:42 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:43 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9" returned: 0 in 0.399s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:43 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a Sep 23 12:49:43 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:43 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a" returned: 0 in 0.432s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:43 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a Sep 23 12:49:43 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:43 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9.863adfb6-3bc9-4d75-95bd-bb8c676ec14a" returned: 0 in 0.244s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] Lock "cinder-quobyte-863adfb6-3bc9-4d75-95bd-bb8c676ec14a" released by "_delete_snapshot" :: held 1.613s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] Lock "cinder-quobyte-f89c7157-fcfe-4396-940f-9732a761beb9" released by "delete_snapshot" :: held 1.639s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:43 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] Created reservations ['cf164e45-ea30-40c1-9127-68f87f5f9922', 'c4b1cf60-2e60-404f-aad4-3365b10b2665', '8169d297-6a1f-4191-80f6-53088f73df30', '4ff6641e-a5bb-4b55-82bd-2b10415ccc54'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:49:43 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] Delete snapshot completed successfully. Sep 23 12:49:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-aa1bda5f-ac45-4dd0-9603-7a92866a6fb8 tempest-VolumesExtendTest-354146542 None] Lock "cinder-863adfb6-3bc9-4d75-95bd-bb8c676ec14a-delete_snapshot" released by "delete_snapshot" :: held 1.795s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] Acquiring lock "cinder-f89c7157-fcfe-4396-940f-9732a761beb9-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] Lock "cinder-f89c7157-fcfe-4396-940f-9732a761beb9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] Acquiring lock "cinder-quobyte-f89c7157-fcfe-4396-940f-9732a761beb9" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] Lock "cinder-quobyte-f89c7157-fcfe-4396-940f-9732a761beb9" acquired by "delete_volume" :: waited 0.015s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:44 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda0e003-8f8f-4717-8336-c30e555ea1d4]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:44 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9 Sep 23 12:49:44 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:44 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9" returned: 0 in 0.383s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:44 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9 Sep 23 12:49:44 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:45 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f89c7157-fcfe-4396-940f-9732a761beb9" returned: 0 in 0.247s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] Lock "cinder-quobyte-f89c7157-fcfe-4396-940f-9732a761beb9" released by "delete_volume" :: held 0.697s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:45 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] Created reservations ['778dd521-91f6-4511-9899-80a0f97adc4d', '352a85b2-c38e-4588-850d-3bb712982f0d', '9e5ee3ce-a3f7-44f0-87df-cc946d8acd01', '8b63e008-b890-4c36-b724-878a028b8189'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:49:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:45 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:49:45 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:45 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.260s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:45 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:49:45 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] Deleted volume successfully. Sep 23 12:49:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c41a898b-2a09-4187-a160-19142824dba5 tempest-VolumesExtendTest-354146542 None] Lock "cinder-f89c7157-fcfe-4396-940f-9732a761beb9-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Flow 'volume_create_manager' (5d1f7085-ab6d-4d2d-bf2e-8e05e5d2a317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc2fd93-4804-4db1-aa4b-c7aca1695e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc2fd93-4804-4db1-aa4b-c7aca1695e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2004848423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29a27d3-9198-4bb1-9f3d-1c3f560a51ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72f512376ee44b39a87dddb021b6d3cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:49:49Z,use_quota=True,user_id='6fb0bfe7de4d46179252edadc46e03ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e182bf8-720b-4f60-bf1e-c36c5088836b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e182bf8-720b-4f60-bf1e-c36c5088836b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39598a0c-6475-4088-9292-d378fb453fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39598a0c-6475-4088-9292-d378fb453fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd29a27d3-9198-4bb1-9f3d-1c3f560a51ca', 'volume_name': 'volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7321dd47-3178-437e-8e16-19e987532965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7321dd47-3178-437e-8e16-19e987532965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e90ce3f-6f50-4754-ac68-6bee8d234b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:49 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Volume d29a27d3-9198-4bb1-9f3d-1c3f560a51ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca', 'volume_size': 1} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2004848423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29a27d3-9198-4bb1-9f3d-1c3f560a51ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72f512376ee44b39a87dddb021b6d3cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:49:49Z,use_quota=True,user_id='6fb0bfe7de4d46179252edadc46e03ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Creating volume d29a27d3-9198-4bb1-9f3d-1c3f560a51ca {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:49:49 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:49 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca 1073741824 Sep 23 12:49:49 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:49 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca 1073741824" returned: 0 in 0.399s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:49 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca Sep 23 12:49:49 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:50 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca" returned: 0 in 0.232s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:49:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e90ce3f-6f50-4754-ac68-6bee8d234b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2693664-8c27-4005-bca7-e0ac15b78e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:49:50 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Volume volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca (d29a27d3-9198-4bb1-9f3d-1c3f560a51ca): created successfully Sep 23 12:49:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2693664-8c27-4005-bca7-e0ac15b78e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:49:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Flow 'volume_create_manager' (5d1f7085-ab6d-4d2d-bf2e-8e05e5d2a317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:49:50 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-7d3874f3-712a-463c-a690-a3068968cc4f tempest-VolumesSnapshotListTestJSON-483450593 None] Created volume successfully. Sep 23 12:49:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-2668453d-efe8-4f2f-bcc5-1e8bef5b2f5d tempest-VolumesSnapshotListTestJSON-483450593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-2668453d-efe8-4f2f-bcc5-1e8bef5b2f5d tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-2668453d-efe8-4f2f-bcc5-1e8bef5b2f5d tempest-VolumesSnapshotListTestJSON-483450593 None] Creating offline snapshot 43a55d2b-fe1e-4780-8b89-bbcba430d0bc of volume d29a27d3-9198-4bb1-9f3d-1c3f560a51ca {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:49:50 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[9478df45-2cbf-4991-92ae-083e8a6739f9]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2668453d-efe8-4f2f-bcc5-1e8bef5b2f5d tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:50 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca Sep 23 12:49:50 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:50 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2668453d-efe8-4f2f-bcc5-1e8bef5b2f5d tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca" returned: 0 in 0.343s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2668453d-efe8-4f2f-bcc5-1e8bef5b2f5d tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:50 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc 1G Sep 23 12:49:50 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:51 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2668453d-efe8-4f2f-bcc5-1e8bef5b2f5d tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc 1G" returned: 0 in 0.378s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2668453d-efe8-4f2f-bcc5-1e8bef5b2f5d tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:51 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc Sep 23 12:49:51 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:51 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2668453d-efe8-4f2f-bcc5-1e8bef5b2f5d tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc" returned: 0 in 0.278s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:51 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-2668453d-efe8-4f2f-bcc5-1e8bef5b2f5d tempest-VolumesSnapshotListTestJSON-483450593 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc is being set with open permissions: ugo+rw Sep 23 12:49:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2668453d-efe8-4f2f-bcc5-1e8bef5b2f5d tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:51 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc Sep 23 12:49:51 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:51 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2668453d-efe8-4f2f-bcc5-1e8bef5b2f5d tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc" returned: 0 in 0.230s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2668453d-efe8-4f2f-bcc5-1e8bef5b2f5d tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:51 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.info Sep 23 12:49:51 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:52 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2668453d-efe8-4f2f-bcc5-1e8bef5b2f5d tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.info" returned: 0 in 0.239s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:52 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-2668453d-efe8-4f2f-bcc5-1e8bef5b2f5d tempest-VolumesSnapshotListTestJSON-483450593 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.info is being set with open permissions: ugo+rw Sep 23 12:49:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2668453d-efe8-4f2f-bcc5-1e8bef5b2f5d tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:52 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.info Sep 23 12:49:52 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:52 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2668453d-efe8-4f2f-bcc5-1e8bef5b2f5d tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.info" returned: 0 in 0.224s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-2668453d-efe8-4f2f-bcc5-1e8bef5b2f5d tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.784s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:52 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-2668453d-efe8-4f2f-bcc5-1e8bef5b2f5d tempest-VolumesSnapshotListTestJSON-483450593 None] Create snapshot completed successfully Sep 23 12:49:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9036498c-7def-444a-833b-033a25b55173 tempest-VolumesSnapshotListTestJSON-483450593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9036498c-7def-444a-833b-033a25b55173 tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-9036498c-7def-444a-833b-033a25b55173 tempest-VolumesSnapshotListTestJSON-483450593 None] Creating offline snapshot f7da463d-035e-4b76-94e0-270e9284663d of volume d29a27d3-9198-4bb1-9f3d-1c3f560a51ca {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:49:52 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ddf571-1877-4f6d-ac62-44afa3b6853f]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9036498c-7def-444a-833b-033a25b55173 tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:52 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc Sep 23 12:49:52 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:53 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9036498c-7def-444a-833b-033a25b55173 tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc" returned: 0 in 0.341s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-9036498c-7def-444a-833b-033a25b55173 tempest-VolumesSnapshotListTestJSON-483450593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:49:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9036498c-7def-444a-833b-033a25b55173 tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:53 devstack sudo[103172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d 1G Sep 23 12:49:53 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:53 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9036498c-7def-444a-833b-033a25b55173 tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d 1G" returned: 0 in 0.399s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9036498c-7def-444a-833b-033a25b55173 tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:53 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d Sep 23 12:49:53 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:53 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9036498c-7def-444a-833b-033a25b55173 tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d" returned: 0 in 0.281s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:53 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-9036498c-7def-444a-833b-033a25b55173 tempest-VolumesSnapshotListTestJSON-483450593 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d is being set with open permissions: ugo+rw Sep 23 12:49:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9036498c-7def-444a-833b-033a25b55173 tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:53 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d Sep 23 12:49:53 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:54 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9036498c-7def-444a-833b-033a25b55173 tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d" returned: 0 in 0.241s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9036498c-7def-444a-833b-033a25b55173 tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.357s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:54 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-9036498c-7def-444a-833b-033a25b55173 tempest-VolumesSnapshotListTestJSON-483450593 None] Create snapshot completed successfully Sep 23 12:49:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3b36dcc9-adbd-4248-96e8-5e432c6e57d7 tempest-VolumesSnapshotListTestJSON-483450593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:49:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3b36dcc9-adbd-4248-96e8-5e432c6e57d7 tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:49:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-3b36dcc9-adbd-4248-96e8-5e432c6e57d7 tempest-VolumesSnapshotListTestJSON-483450593 None] Creating offline snapshot c2ac2f8b-456b-48e4-b70b-d0c7fad924a9 of volume d29a27d3-9198-4bb1-9f3d-1c3f560a51ca {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:49:55 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[840b4517-804e-45c5-9e5c-03b46e2ede07]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3b36dcc9-adbd-4248-96e8-5e432c6e57d7 tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:55 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d Sep 23 12:49:55 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:55 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3b36dcc9-adbd-4248-96e8-5e432c6e57d7 tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d" returned: 0 in 0.352s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-3b36dcc9-adbd-4248-96e8-5e432c6e57d7 tempest-VolumesSnapshotListTestJSON-483450593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:49:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3b36dcc9-adbd-4248-96e8-5e432c6e57d7 tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:55 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9 1G Sep 23 12:49:55 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:55 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3b36dcc9-adbd-4248-96e8-5e432c6e57d7 tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9 1G" returned: 0 in 0.423s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3b36dcc9-adbd-4248-96e8-5e432c6e57d7 tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:55 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9 Sep 23 12:49:55 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:56 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3b36dcc9-adbd-4248-96e8-5e432c6e57d7 tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9" returned: 0 in 0.273s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:56 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-3b36dcc9-adbd-4248-96e8-5e432c6e57d7 tempest-VolumesSnapshotListTestJSON-483450593 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9 is being set with open permissions: ugo+rw Sep 23 12:49:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3b36dcc9-adbd-4248-96e8-5e432c6e57d7 tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:56 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9 Sep 23 12:49:56 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:56 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3b36dcc9-adbd-4248-96e8-5e432c6e57d7 tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9" returned: 0 in 0.229s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3b36dcc9-adbd-4248-96e8-5e432c6e57d7 tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.370s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:49:56 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-3b36dcc9-adbd-4248-96e8-5e432c6e57d7 tempest-VolumesSnapshotListTestJSON-483450593 None] Create snapshot completed successfully Sep 23 12:49:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] Acquiring lock "cinder-c2ac2f8b-456b-48e4-b70b-d0c7fad924a9-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-c2ac2f8b-456b-48e4-b70b-d0c7fad924a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] Acquiring lock "cinder-quobyte-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-quobyte-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] Acquiring lock "cinder-quobyte-c2ac2f8b-456b-48e4-b70b-d0c7fad924a9" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:49:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-quobyte-c2ac2f8b-456b-48e4-b70b-d0c7fad924a9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:49:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] Deleting offline snapshot c2ac2f8b-456b-48e4-b70b-d0c7fad924a9 of volume d29a27d3-9198-4bb1-9f3d-1c3f560a51ca {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:49:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] snapshot_file for this snap is: volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:49:58 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e525de-4ff1-443b-8a75-6d7a3cf1f854]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:58 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9 Sep 23 12:49:58 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:58 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9" returned: 0 in 0.344s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:49:58 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a75d77-1a54-427d-84ac-9f130b50e04a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:49:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:58 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d Sep 23 12:49:58 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:58 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d" returned: 0 in 0.347s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:49:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:58 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9 Sep 23 12:49:58 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:59 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9" returned: 0 in 0.401s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:49:59 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9 Sep 23 12:49:59 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:49:59 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Sep 23 12:49:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.c2ac2f8b-456b-48e4-b70b-d0c7fad924a9" returned: 0 in 0.241s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:49:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-quobyte-c2ac2f8b-456b-48e4-b70b-d0c7fad924a9" released by "_delete_snapshot" :: held 1.429s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-quobyte-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca" released by "delete_snapshot" :: held 1.455s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:49:59 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] Created reservations ['ae63fd2a-5557-4228-8937-1f5c7652a846', '3db7dbc9-a092-46ea-aac9-8e57c24f8793', 'd414ecca-c7a0-49aa-a7fd-8bb447be5d3b', '16fd8e1c-9ac7-4f95-94a1-6081e781cdd2'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:49:59 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] Delete snapshot completed successfully. Sep 23 12:49:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-2b1d79f4-3951-4311-8028-4cfa123257cc tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-c2ac2f8b-456b-48e4-b70b-d0c7fad924a9-delete_snapshot" released by "delete_snapshot" :: held 1.583s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:50:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] Acquiring lock "cinder-f7da463d-035e-4b76-94e0-270e9284663d-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:50:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-f7da463d-035e-4b76-94e0-270e9284663d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:50:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] Acquiring lock "cinder-quobyte-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:50:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-quobyte-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:50:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] Acquiring lock "cinder-quobyte-f7da463d-035e-4b76-94e0-270e9284663d" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:50:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-quobyte-f7da463d-035e-4b76-94e0-270e9284663d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:50:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] Deleting offline snapshot f7da463d-035e-4b76-94e0-270e9284663d of volume d29a27d3-9198-4bb1-9f3d-1c3f560a51ca {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:50:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] snapshot_file for this snap is: volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:50:00 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e799c2-0427-43b8-860f-13ae3a441de4]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:50:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:50:00 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d Sep 23 12:50:00 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:50:00 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Sep 23 12:50:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d" returned: 0 in 0.354s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:50:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:50:00 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[827dddc3-04c8-41fb-b249-290e7a9a7e1d]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:50:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:50:00 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc Sep 23 12:50:00 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:50:00 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Sep 23 12:50:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc" returned: 0 in 0.338s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:50:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:50:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:50:00 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d Sep 23 12:50:00 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:50:01 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Sep 23 12:50:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d" returned: 0 in 0.358s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:50:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:50:01 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d Sep 23 12:50:01 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:50:01 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Sep 23 12:50:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.f7da463d-035e-4b76-94e0-270e9284663d" returned: 0 in 0.242s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:50:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-quobyte-f7da463d-035e-4b76-94e0-270e9284663d" released by "_delete_snapshot" :: held 1.391s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:50:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-quobyte-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca" released by "delete_snapshot" :: held 1.412s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:50:01 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] Created reservations ['51c965d9-1ce7-4bf9-bdaf-e1a3b630d9c4', '68b2e373-1666-4727-896e-78ef8e2eb81f', '66409a4f-9eea-4a65-8e83-a1ba506a620e', '51204256-e566-4413-9cc2-2d1bf6072a7e'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:50:01 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] Delete snapshot completed successfully. Sep 23 12:50:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0c68d211-7e93-4387-920f-ebed8ebb467e tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-f7da463d-035e-4b76-94e0-270e9284663d-delete_snapshot" released by "delete_snapshot" :: held 1.558s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:50:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] Acquiring lock "cinder-43a55d2b-fe1e-4780-8b89-bbcba430d0bc-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:50:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-43a55d2b-fe1e-4780-8b89-bbcba430d0bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:50:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] Acquiring lock "cinder-quobyte-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:50:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-quobyte-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:50:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] Acquiring lock "cinder-quobyte-43a55d2b-fe1e-4780-8b89-bbcba430d0bc" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:50:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-quobyte-43a55d2b-fe1e-4780-8b89-bbcba430d0bc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:50:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] Deleting offline snapshot 43a55d2b-fe1e-4780-8b89-bbcba430d0bc of volume d29a27d3-9198-4bb1-9f3d-1c3f560a51ca {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:50:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] snapshot_file for this snap is: volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:50:02 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccab8dd5-cc7e-4d9a-82c8-35207c308400]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:50:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:50:02 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc Sep 23 12:50:02 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:50:02 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Sep 23 12:50:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc" returned: 0 in 0.362s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:50:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:50:02 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd785605-5b09-4f85-afe7-e0791328edce]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:50:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:50:02 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca Sep 23 12:50:02 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:50:03 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Sep 23 12:50:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca" returned: 0 in 0.351s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:50:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:50:03 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc Sep 23 12:50:03 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:50:03 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Sep 23 12:50:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc" returned: 0 in 0.317s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:50:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:50:03 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc Sep 23 12:50:03 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:50:03 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Sep 23 12:50:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca.43a55d2b-fe1e-4780-8b89-bbcba430d0bc" returned: 0 in 0.256s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:50:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-quobyte-43a55d2b-fe1e-4780-8b89-bbcba430d0bc" released by "_delete_snapshot" :: held 1.393s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:50:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-quobyte-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca" released by "delete_snapshot" :: held 1.417s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:50:03 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] Created reservations ['8028b4c0-0a4e-4c9a-9215-ca8547384408', 'd1c7de82-5dcd-4dbb-891f-a0a6f17b6a66', '130ef784-bd77-4029-a7c6-4d5814fb4264', '8361c02e-9c3d-4664-96d4-9f13763191a7'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:50:03 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] Delete snapshot completed successfully. Sep 23 12:50:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7195b48b-5598-4b77-98d7-ff1ff8194576 tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-43a55d2b-fe1e-4780-8b89-bbcba430d0bc-delete_snapshot" released by "delete_snapshot" :: held 1.557s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:50:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] Acquiring lock "cinder-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:50:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:50:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] Acquiring lock "cinder-quobyte-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:50:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-quobyte-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca" acquired by "delete_volume" :: waited 0.013s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:50:04 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a933b0-c4b7-457f-b3dc-26200b0dc876]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:50:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:50:04 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca Sep 23 12:50:04 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:50:04 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Sep 23 12:50:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca" returned: 0 in 0.343s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:50:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:50:04 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca Sep 23 12:50:04 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:50:05 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Sep 23 12:50:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca" returned: 0 in 0.240s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:50:05 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-quobyte-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca" released by "delete_volume" :: held 0.639s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:50:05 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] Created reservations ['ab758d53-8a5e-4007-958f-2f360e8efd1b', 'c7e06754-6ef3-4cab-b9a8-2d6afca42fcf', '0e2de2e4-81a5-4904-bb96-93ec75384d28', '31875554-b432-4ccf-b187-49ef03eb5871'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:50:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:50:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:50:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:50:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:50:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:50:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:50:05 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:50:05 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:50:05 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Sep 23 12:50:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.240s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:50:05 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:50:05 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] Deleted volume successfully. Sep 23 12:50:05 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-01ab1b61-e932-4fa8-a18e-fbafcd71f820 tempest-VolumesSnapshotListTestJSON-483450593 None] Lock "cinder-d29a27d3-9198-4bb1-9f3d-1c3f560a51ca-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:50:15 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:UPDATE=141,cinder:DELETE=13,cinder:SELECT=114,cinder:INSERT=43 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:50:15 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=112,cinder:INSERT=46,cinder:UPDATE=129,cinder:DELETE=8 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:50:37 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:50:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:50:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:50:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:50:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:50:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:50:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:50:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:50:41 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:50:41 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:50:41 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Sep 23 12:50:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.253s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:50:41 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:50:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:50:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:50:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Flow 'volume_create_manager' (2cedcdb4-e478-4450-a59d-797cfe3a36ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b141d4e-91fd-426c-952d-20ce250333d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b141d4e-91fd-426c-952d-20ce250333d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-186513335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa81bba-ed57-45a5-b4e3-864eb4b4890a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbbba29071e466b9a54116212b14eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:50:59Z,use_quota=True,user_id='05edfb49294042eaacac7d7f0f9b2090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ea0e1e-5177-4dad-8e1d-226d11deed07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ea0e1e-5177-4dad-8e1d-226d11deed07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f75b28-bf29-487d-9980-9b17dc2d0637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f75b28-bf29-487d-9980-9b17dc2d0637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfa81bba-ed57-45a5-b4e3-864eb4b4890a', 'volume_name': 'volume-dfa81bba-ed57-45a5-b4e3-864eb4b4890a', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a14c205-2e3a-42bf-a410-267747b1ea93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a14c205-2e3a-42bf-a410-267747b1ea93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7efd9e1d-c12c-43b1-b9c4-7d19b776f803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:50:58 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Volume dfa81bba-ed57-45a5-b4e3-864eb4b4890a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfa81bba-ed57-45a5-b4e3-864eb4b4890a', 'volume_size': 1} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-186513335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa81bba-ed57-45a5-b4e3-864eb4b4890a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbbba29071e466b9a54116212b14eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:50:59Z,use_quota=True,user_id='05edfb49294042eaacac7d7f0f9b2090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Creating volume dfa81bba-ed57-45a5-b4e3-864eb4b4890a {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:50:58 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:50:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dfa81bba-ed57-45a5-b4e3-864eb4b4890a 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:50:58 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dfa81bba-ed57-45a5-b4e3-864eb4b4890a 1073741824 Sep 23 12:50:58 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:50:59 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Sep 23 12:50:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dfa81bba-ed57-45a5-b4e3-864eb4b4890a 1073741824" returned: 0 in 0.421s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:50:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dfa81bba-ed57-45a5-b4e3-864eb4b4890a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:50:59 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dfa81bba-ed57-45a5-b4e3-864eb4b4890a Sep 23 12:50:59 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:50:59 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Sep 23 12:50:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dfa81bba-ed57-45a5-b4e3-864eb4b4890a" returned: 0 in 0.243s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:50:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:50:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:50:59 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7efd9e1d-c12c-43b1-b9c4-7d19b776f803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfa81bba-ed57-45a5-b4e3-864eb4b4890a', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:50:59 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4933c577-ca94-45bc-ac4e-455e730c560d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:50:59 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Volume volume-dfa81bba-ed57-45a5-b4e3-864eb4b4890a (dfa81bba-ed57-45a5-b4e3-864eb4b4890a): created successfully Sep 23 12:50:59 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4933c577-ca94-45bc-ac4e-455e730c560d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:50:59 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Flow 'volume_create_manager' (2cedcdb4-e478-4450-a59d-797cfe3a36ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:50:59 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-9510c05b-b5bf-4ae3-ae58-bba8f72e5c85 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Created volume successfully. Sep 23 12:51:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-a77cc80b-09e2-40eb-9c75-3789672d5ad8 req-bf13b65e-9759-4e61-b0e9-99b3de865422 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:51:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-a77cc80b-09e2-40eb-9c75-3789672d5ad8 req-bf13b65e-9759-4e61-b0e9-99b3de865422 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:51:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-a77cc80b-09e2-40eb-9c75-3789672d5ad8 req-bf13b65e-9759-4e61-b0e9-99b3de865422 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:51:00 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-a77cc80b-09e2-40eb-9c75-3789672d5ad8 req-bf13b65e-9759-4e61-b0e9-99b3de865422 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-dfa81bba-ed57-45a5-b4e3-864eb4b4890a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8eac4ae-b899-45fe-8df1-1bf3cc3f4d94', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:51:00 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-a77cc80b-09e2-40eb-9c75-3789672d5ad8 req-bf13b65e-9759-4e61-b0e9-99b3de865422 tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] attachment_update completed successfully. Sep 23 12:51:02 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-e59e9cec-faad-47d0-8a4c-401f580cd121 req-bf8beb58-46b5-48d5-a012-838cdbacb5fc tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Terminate volume connection completed successfully. Sep 23 12:51:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-e59e9cec-faad-47d0-8a4c-401f580cd121 req-bf8beb58-46b5-48d5-a012-838cdbacb5fc tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Deleting attachment b8eac4ae-b899-45fe-8df1-1bf3cc3f4d94. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:51:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Acquiring lock "cinder-dfa81bba-ed57-45a5-b4e3-864eb4b4890a-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:51:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Lock "cinder-dfa81bba-ed57-45a5-b4e3-864eb4b4890a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:51:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Acquiring lock "cinder-quobyte-dfa81bba-ed57-45a5-b4e3-864eb4b4890a" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:51:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Lock "cinder-quobyte-dfa81bba-ed57-45a5-b4e3-864eb4b4890a" acquired by "delete_volume" :: waited 0.014s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:51:03 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaf3652-c6ad-45f1-919f-bb29637db98b]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:51:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dfa81bba-ed57-45a5-b4e3-864eb4b4890a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:51:03 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dfa81bba-ed57-45a5-b4e3-864eb4b4890a Sep 23 12:51:03 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:51:03 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Sep 23 12:51:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dfa81bba-ed57-45a5-b4e3-864eb4b4890a" returned: 0 in 0.355s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:51:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dfa81bba-ed57-45a5-b4e3-864eb4b4890a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:51:03 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dfa81bba-ed57-45a5-b4e3-864eb4b4890a Sep 23 12:51:03 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:51:04 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Sep 23 12:51:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dfa81bba-ed57-45a5-b4e3-864eb4b4890a" returned: 0 in 0.237s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:51:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Lock "cinder-quobyte-dfa81bba-ed57-45a5-b4e3-864eb4b4890a" released by "delete_volume" :: held 0.632s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:51:04 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Created reservations ['b2a77849-f689-4860-b11b-a1733ab703a4', '842d3da9-3aeb-460d-9b37-b56066b6064b', 'b69fa503-d46e-4d97-a296-ecf142d49b74', 'c742f3ef-b77c-43ce-a763-1a31c26ec1ef'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:51:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:51:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:51:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:51:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:51:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:51:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:51:04 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:51:04 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:51:04 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Sep 23 12:51:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.230s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:51:04 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:51:04 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Deleted volume successfully. Sep 23 12:51:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b6644915-f9dd-4624-89f3-0125b18b5d6e tempest-TestServerVolumeAttachScenarioOldVersion-1013668048 None] Lock "cinder-dfa81bba-ed57-45a5-b4e3-864eb4b4890a-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:51:14 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=14,cinder:UPDATE=13,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:51:14 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=15,cinder:UPDATE=12,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:51:39 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:51:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Flow 'volume_create_manager' (645280cf-ff66-4cb6-9440-cb3b71e2c973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:51:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8dbe7e-0d20-4f4c-a8c6-9609fe663877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8dbe7e-0d20-4f4c-a8c6-9609fe663877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-449767860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdb6901-b604-4b17-bf7e-90c30b2c2f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4607ab8a264f38a281a9ce7c99ca9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:51:40Z,use_quota=True,user_id='20d0d66fdcfd439480d5f6fedbba5f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69abba6d-fa2f-4293-86e2-784d8c8d3633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69abba6d-fa2f-4293-86e2-784d8c8d3633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b12fd9-ccf4-4026-82c4-ae376855c9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b12fd9-ccf4-4026-82c4-ae376855c9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bdb6901-b604-4b17-bf7e-90c30b2c2f61', 'volume_name': 'volume-8bdb6901-b604-4b17-bf7e-90c30b2c2f61', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5333e529-e2c2-4606-9cb0-980eb4b81c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5333e529-e2c2-4606-9cb0-980eb4b81c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130214fc-8e5d-48cb-bd96-77831a165d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:51:40 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Volume 8bdb6901-b604-4b17-bf7e-90c30b2c2f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bdb6901-b604-4b17-bf7e-90c30b2c2f61', 'volume_size': 1} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-449767860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdb6901-b604-4b17-bf7e-90c30b2c2f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4607ab8a264f38a281a9ce7c99ca9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:51:40Z,use_quota=True,user_id='20d0d66fdcfd439480d5f6fedbba5f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Creating volume 8bdb6901-b604-4b17-bf7e-90c30b2c2f61 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:51:40 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8bdb6901-b604-4b17-bf7e-90c30b2c2f61 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:51:40 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8bdb6901-b604-4b17-bf7e-90c30b2c2f61 1073741824 Sep 23 12:51:40 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Flow 'volume_create_manager' (29b1197f-14cf-4737-be8e-f7357f22016e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a446b6fd-1107-4bb3-b22d-e002fe61b689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a446b6fd-1107-4bb3-b22d-e002fe61b689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-212678692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4607ab8a264f38a281a9ce7c99ca9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:51:40Z,use_quota=True,user_id='20d0d66fdcfd439480d5f6fedbba5f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2dfabd-bb75-4953-a40f-dcd67c4d1bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2dfabd-bb75-4953-a40f-dcd67c4d1bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e931dc93-e6b4-4b4c-b2b7-c48bde867677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e931dc93-e6b4-4b4c-b2b7-c48bde867677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9', 'volume_name': 'volume-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5729b00a-7441-4c5f-aa39-70c3c4cf5886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5729b00a-7441-4c5f-aa39-70c3c4cf5886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd46ac6-334a-4fb6-a0a7-00c67f79cb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:51:40 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Volume f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9', 'volume_size': 1} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:51:40 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8bdb6901-b604-4b17-bf7e-90c30b2c2f61 1073741824" returned: 0 in 0.528s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8bdb6901-b604-4b17-bf7e-90c30b2c2f61 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:51:40 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8bdb6901-b604-4b17-bf7e-90c30b2c2f61 Sep 23 12:51:40 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:51:40 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8bdb6901-b604-4b17-bf7e-90c30b2c2f61" returned: 0 in 0.280s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.467s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-212678692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4607ab8a264f38a281a9ce7c99ca9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:51:40Z,use_quota=True,user_id='20d0d66fdcfd439480d5f6fedbba5f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Creating volume f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:51:40 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:51:40 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9 1073741824 Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130214fc-8e5d-48cb-bd96-77831a165d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bdb6901-b604-4b17-bf7e-90c30b2c2f61', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:51:40 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05b9945-c950-4e01-b97c-2d69711b6ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:51:40 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Volume volume-8bdb6901-b604-4b17-bf7e-90c30b2c2f61 (8bdb6901-b604-4b17-bf7e-90c30b2c2f61): created successfully Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05b9945-c950-4e01-b97c-2d69711b6ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:51:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Flow 'volume_create_manager' (645280cf-ff66-4cb6-9440-cb3b71e2c973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:51:41 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-bddff625-d2b9-4f63-b881-997921ffd56d tempest-TestServerVolumeAttachmentScenario-1715001050 None] Created volume successfully. Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:51:41 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9 1073741824" returned: 0 in 0.491s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:51:41 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:51:41 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:51:41 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9 Sep 23 12:51:41 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:51:41 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.267s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:51:41 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9" returned: 0 in 0.258s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd46ac6-334a-4fb6-a0a7-00c67f79cb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73a4a4b-a3b0-4a6a-b5be-f22c082ae798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:51:41 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Volume volume-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9 (f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9): created successfully Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73a4a4b-a3b0-4a6a-b5be-f22c082ae798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:51:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Flow 'volume_create_manager' (29b1197f-14cf-4737-be8e-f7357f22016e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:51:41 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0706d35f-22f3-4df2-8c33-cec49507ac78 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Created volume successfully. Sep 23 12:51:51 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:51:51 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=4,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:52:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-e50eb26f-7549-4f91-aec2-ab23a545dccd req-8ef45df9-d2b5-452c-ab1c-53ad580d1638 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-e50eb26f-7549-4f91-aec2-ab23a545dccd req-8ef45df9-d2b5-452c-ab1c-53ad580d1638 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-e50eb26f-7549-4f91-aec2-ab23a545dccd req-8ef45df9-d2b5-452c-ab1c-53ad580d1638 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-e50eb26f-7549-4f91-aec2-ab23a545dccd req-8ef45df9-d2b5-452c-ab1c-53ad580d1638 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-8bdb6901-b604-4b17-bf7e-90c30b2c2f61', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4011b99-95d6-4a12-be47-31a61bab789a', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:52:12 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-e50eb26f-7549-4f91-aec2-ab23a545dccd req-8ef45df9-d2b5-452c-ab1c-53ad580d1638 tempest-TestServerVolumeAttachmentScenario-1715001050 None] attachment_update completed successfully. Sep 23 12:52:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-3974a931-c6d2-4f1d-9c04-a66daa393525 req-cc108806-8cc6-4029-91c2-45f5e126a4f7 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-3974a931-c6d2-4f1d-9c04-a66daa393525 req-cc108806-8cc6-4029-91c2-45f5e126a4f7 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [req-3974a931-c6d2-4f1d-9c04-a66daa393525 req-cc108806-8cc6-4029-91c2-45f5e126a4f7 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-3974a931-c6d2-4f1d-9c04-a66daa393525 req-cc108806-8cc6-4029-91c2-45f5e126a4f7 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68', 'name': 'volume-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e960892-e455-4d7e-806d-867fe895aa9b', 'enforce_multipath': True} {{(pid=86085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 12:52:15 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-3974a931-c6d2-4f1d-9c04-a66daa393525 req-cc108806-8cc6-4029-91c2-45f5e126a4f7 tempest-TestServerVolumeAttachmentScenario-1715001050 None] attachment_update completed successfully. Sep 23 12:52:16 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-1956d708-6f57-4b77-b578-980304ab84c5 req-04b4b759-2d0b-4c2d-9087-1a29881b8254 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Terminate volume connection completed successfully. Sep 23 12:52:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-1956d708-6f57-4b77-b578-980304ab84c5 req-04b4b759-2d0b-4c2d-9087-1a29881b8254 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Deleting attachment 9e960892-e455-4d7e-806d-867fe895aa9b. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:52:18 devstack cinder-volume[86085]: INFO cinder.volume.manager [req-ce707e27-935b-4193-8f60-ec97773578c7 req-f5548ef2-305f-443c-b999-69bd11944b9e tempest-TestServerVolumeAttachmentScenario-1715001050 None] Terminate volume connection completed successfully. Sep 23 12:52:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [req-ce707e27-935b-4193-8f60-ec97773578c7 req-f5548ef2-305f-443c-b999-69bd11944b9e tempest-TestServerVolumeAttachmentScenario-1715001050 None] Deleting attachment c4011b99-95d6-4a12-be47-31a61bab789a. {{(pid=86085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 12:52:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] Acquiring lock "cinder-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "cinder-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] Acquiring lock "cinder-quobyte-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:22 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "cinder-quobyte-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9" acquired by "delete_volume" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:22 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff56942c-da98-4cdb-b080-54ea40b3e44a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:52:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:23 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9 Sep 23 12:52:23 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:23 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9" returned: 0 in 0.379s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:23 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9 Sep 23 12:52:23 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:23 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9" returned: 0 in 0.266s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "cinder-quobyte-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9" released by "delete_volume" :: held 0.690s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:23 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] Created reservations ['fa67e5ef-1696-4ef8-83f6-b0563b915508', '24b0e538-cdee-480a-bcda-ce977f213e5a', '5c34e3cf-97bf-4b35-aa56-ba16405dc51e', '51c1df17-906b-472e-b526-14e56434ab07'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:52:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:23 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:52:23 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:23 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.254s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:23 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:52:23 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] Deleted volume successfully. Sep 23 12:52:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e2cf638c-71c6-408f-b0cb-2dca00efaffe tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "cinder-f29b76a5-2cd3-4af2-a47a-0ff76dbe9fe9-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Acquiring lock "cinder-8bdb6901-b604-4b17-bf7e-90c30b2c2f61-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "cinder-8bdb6901-b604-4b17-bf7e-90c30b2c2f61-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Acquiring lock "cinder-quobyte-8bdb6901-b604-4b17-bf7e-90c30b2c2f61" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "cinder-quobyte-8bdb6901-b604-4b17-bf7e-90c30b2c2f61" acquired by "delete_volume" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:24 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6fbc46-9843-4c26-9190-dc404daf7961]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:52:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8bdb6901-b604-4b17-bf7e-90c30b2c2f61 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:24 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8bdb6901-b604-4b17-bf7e-90c30b2c2f61 Sep 23 12:52:24 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:24 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8bdb6901-b604-4b17-bf7e-90c30b2c2f61" returned: 0 in 0.382s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8bdb6901-b604-4b17-bf7e-90c30b2c2f61 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:24 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8bdb6901-b604-4b17-bf7e-90c30b2c2f61 Sep 23 12:52:24 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:24 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8bdb6901-b604-4b17-bf7e-90c30b2c2f61" returned: 0 in 0.267s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "cinder-quobyte-8bdb6901-b604-4b17-bf7e-90c30b2c2f61" released by "delete_volume" :: held 0.696s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:24 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Created reservations ['65273a48-3988-4ec0-b58c-e84c5035cde1', '3b07d477-c6e1-499e-bd7e-f38d7590baa0', 'f534ff7a-e728-487d-bb85-5e9a87527fc7', '15f7fc35-29f7-4857-b94c-82023bbe9d8e'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:52:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:24 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:52:24 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:25 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.268s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:25 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:52:25 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Deleted volume successfully. Sep 23 12:52:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d726bec5-c5a0-47fc-9ac6-424896f58b49 tempest-TestServerVolumeAttachmentScenario-1715001050 None] Lock "cinder-8bdb6901-b604-4b17-bf7e-90c30b2c2f61-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Flow 'volume_create_manager' (4f1efeec-bf28-4e1b-944c-daa250efe84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97fba91-e7cd-4185-88fd-829340088b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97fba91-e7cd-4185-88fd-829340088b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-21836590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39d6d76-63f9-4100-80d9-f21af5b3941e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09b27286a764529b645292a86f1773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:36Z,use_quota=True,user_id='e92fcb99cdcd4907bfffcafd964963b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8233f2b-bebc-4db8-ae5e-5298a187015c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8233f2b-bebc-4db8-ae5e-5298a187015c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03195443-06a2-40d1-8793-9a4adb08bbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03195443-06a2-40d1-8793-9a4adb08bbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd39d6d76-63f9-4100-80d9-f21af5b3941e', 'volume_name': 'volume-d39d6d76-63f9-4100-80d9-f21af5b3941e', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7d5793-cb4f-4651-af6e-8657ba21ee46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7d5793-cb4f-4651-af6e-8657ba21ee46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c23a207-5862-48c1-b32a-62d53f2671df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:36 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Volume d39d6d76-63f9-4100-80d9-f21af5b3941e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d39d6d76-63f9-4100-80d9-f21af5b3941e', 'volume_size': 1} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-21836590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39d6d76-63f9-4100-80d9-f21af5b3941e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09b27286a764529b645292a86f1773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:36Z,use_quota=True,user_id='e92fcb99cdcd4907bfffcafd964963b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Creating volume d39d6d76-63f9-4100-80d9-f21af5b3941e {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:52:36 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d39d6d76-63f9-4100-80d9-f21af5b3941e 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:36 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d39d6d76-63f9-4100-80d9-f21af5b3941e 1073741824 Sep 23 12:52:36 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Flow 'volume_create_manager' (d09ba7f6-ce12-495e-853f-fb598f79aa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a229dd53-e3c0-40ef-8ad7-4add92dba5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a229dd53-e3c0-40ef-8ad7-4add92dba5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2094448512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e335287-5b34-4f4f-8c56-721e2ef5e6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09b27286a764529b645292a86f1773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:36Z,use_quota=True,user_id='e92fcb99cdcd4907bfffcafd964963b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4677cc2d-eef5-40a7-8600-44bf4bcd33e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4677cc2d-eef5-40a7-8600-44bf4bcd33e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845a3a7c-ea3f-4b0e-93da-143516351450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845a3a7c-ea3f-4b0e-93da-143516351450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e335287-5b34-4f4f-8c56-721e2ef5e6a3', 'volume_name': 'volume-3e335287-5b34-4f4f-8c56-721e2ef5e6a3', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f785e90-c0c2-456b-9a04-5deeeb85b051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f785e90-c0c2-456b-9a04-5deeeb85b051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a426fb5b-f395-4bc1-a560-8c9cdb8660eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:36 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Volume 3e335287-5b34-4f4f-8c56-721e2ef5e6a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e335287-5b34-4f4f-8c56-721e2ef5e6a3', 'volume_size': 1} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:36 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d39d6d76-63f9-4100-80d9-f21af5b3941e 1073741824" returned: 0 in 0.519s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d39d6d76-63f9-4100-80d9-f21af5b3941e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:36 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d39d6d76-63f9-4100-80d9-f21af5b3941e Sep 23 12:52:36 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Flow 'volume_create_manager' (d42006b0-e15c-443b-961b-a155a3d8b232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372a2f7c-f63c-4276-81a8-8353a1256cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372a2f7c-f63c-4276-81a8-8353a1256cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-826052025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5806ad9-80fd-493f-8da0-14f81a930896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09b27286a764529b645292a86f1773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:37Z,use_quota=True,user_id='e92fcb99cdcd4907bfffcafd964963b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c00e07-ca84-4a81-9c20-37becefd74e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c00e07-ca84-4a81-9c20-37becefd74e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b8d7b2-ff88-4eeb-a9c9-674eeb2e41ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b8d7b2-ff88-4eeb-a9c9-674eeb2e41ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5806ad9-80fd-493f-8da0-14f81a930896', 'volume_name': 'volume-a5806ad9-80fd-493f-8da0-14f81a930896', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc21e25-2459-4bde-b744-68e621427a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc21e25-2459-4bde-b744-68e621427a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3305849a-7f71-4001-b6b5-c6b9a4f380a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:36 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Volume a5806ad9-80fd-493f-8da0-14f81a930896: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5806ad9-80fd-493f-8da0-14f81a930896', 'volume_size': 1} Sep 23 12:52:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:36 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d39d6d76-63f9-4100-80d9-f21af5b3941e" returned: 0 in 0.281s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.503s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2094448512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e335287-5b34-4f4f-8c56-721e2ef5e6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09b27286a764529b645292a86f1773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:36Z,use_quota=True,user_id='e92fcb99cdcd4907bfffcafd964963b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Creating volume 3e335287-5b34-4f4f-8c56-721e2ef5e6a3 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:52:37 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e335287-5b34-4f4f-8c56-721e2ef5e6a3 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c23a207-5862-48c1-b32a-62d53f2671df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d39d6d76-63f9-4100-80d9-f21af5b3941e', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a850db-8227-4f78-85ee-49ab1030e005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:37 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e335287-5b34-4f4f-8c56-721e2ef5e6a3 1073741824 Sep 23 12:52:37 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:37 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Volume volume-d39d6d76-63f9-4100-80d9-f21af5b3941e (d39d6d76-63f9-4100-80d9-f21af5b3941e): created successfully Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a850db-8227-4f78-85ee-49ab1030e005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Flow 'volume_create_manager' (4f1efeec-bf28-4e1b-944c-daa250efe84c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:37 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-7534dc7f-da34-4bee-b49f-b836034fc3c2 tempest-CreateVolumesFromImageTest-457785607 None] Created volume successfully. Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Flow 'volume_create_manager' (087e4853-48d7-4509-bf34-dd091fda09f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d54b86-68e9-4e37-8bd5-c45e8c0a74f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d54b86-68e9-4e37-8bd5-c45e8c0a74f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1280686849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e01a939-7e09-4815-8079-e39a03bc05a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09b27286a764529b645292a86f1773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:37Z,use_quota=True,user_id='e92fcb99cdcd4907bfffcafd964963b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70dc9e3b-cdcd-4386-9377-1b430621fc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70dc9e3b-cdcd-4386-9377-1b430621fc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6affa62-1f94-4d41-aad8-090c90fabfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6affa62-1f94-4d41-aad8-090c90fabfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e01a939-7e09-4815-8079-e39a03bc05a5', 'volume_name': 'volume-6e01a939-7e09-4815-8079-e39a03bc05a5', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77013a20-d975-4c9e-91e0-4f6e617e523e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77013a20-d975-4c9e-91e0-4f6e617e523e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b3354a-ebff-4676-9ba8-32845d5f086d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:37 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Volume 6e01a939-7e09-4815-8079-e39a03bc05a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e01a939-7e09-4815-8079-e39a03bc05a5', 'volume_size': 1} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Flow 'volume_create_manager' (1581c53d-2593-4642-94b3-de5077145cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738c4bfc-c6e4-4933-8f28-7d3100e95f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:37 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e335287-5b34-4f4f-8c56-721e2ef5e6a3 1073741824" returned: 0 in 0.527s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738c4bfc-c6e4-4933-8f28-7d3100e95f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-819660257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6bc9166-2be9-46d1-a46b-24236c089f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09b27286a764529b645292a86f1773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:37Z,use_quota=True,user_id='e92fcb99cdcd4907bfffcafd964963b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fce55ec-798a-4f36-ab7f-beebcb03c748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fce55ec-798a-4f36-ab7f-beebcb03c748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c94ca7a-a305-4997-81aa-80701ea186c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c94ca7a-a305-4997-81aa-80701ea186c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6bc9166-2be9-46d1-a46b-24236c089f56', 'volume_name': 'volume-b6bc9166-2be9-46d1-a46b-24236c089f56', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa17fcb-ce11-4d48-a472-0137bd47b296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa17fcb-ce11-4d48-a472-0137bd47b296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1210464-4e87-4827-8f14-bc8c28b7f54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:37 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Volume b6bc9166-2be9-46d1-a46b-24236c089f56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6bc9166-2be9-46d1-a46b-24236c089f56', 'volume_size': 1} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e335287-5b34-4f4f-8c56-721e2ef5e6a3 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:37 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e335287-5b34-4f4f-8c56-721e2ef5e6a3 Sep 23 12:52:37 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:37 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e335287-5b34-4f4f-8c56-721e2ef5e6a3" returned: 0 in 0.249s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.987s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-826052025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5806ad9-80fd-493f-8da0-14f81a930896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09b27286a764529b645292a86f1773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:37Z,use_quota=True,user_id='e92fcb99cdcd4907bfffcafd964963b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Creating volume a5806ad9-80fd-493f-8da0-14f81a930896 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:52:37 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a5806ad9-80fd-493f-8da0-14f81a930896 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a426fb5b-f395-4bc1-a560-8c9cdb8660eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e335287-5b34-4f4f-8c56-721e2ef5e6a3', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:37 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a5806ad9-80fd-493f-8da0-14f81a930896 1073741824 Sep 23 12:52:37 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fad9df-7494-43b4-a709-7f23147f2a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:37 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Volume volume-3e335287-5b34-4f4f-8c56-721e2ef5e6a3 (3e335287-5b34-4f4f-8c56-721e2ef5e6a3): created successfully Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fad9df-7494-43b4-a709-7f23147f2a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Flow 'volume_create_manager' (d09ba7f6-ce12-495e-853f-fb598f79aa75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:37 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-bdbe03dc-e0a1-41a1-8373-e86299bd8c2e tempest-CreateVolumesFromImageTest-457785607 None] Created volume successfully. Sep 23 12:52:38 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a5806ad9-80fd-493f-8da0-14f81a930896 1073741824" returned: 0 in 0.452s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a5806ad9-80fd-493f-8da0-14f81a930896 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:38 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a5806ad9-80fd-493f-8da0-14f81a930896 Sep 23 12:52:38 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:38 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a5806ad9-80fd-493f-8da0-14f81a930896" returned: 0 in 0.242s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:52:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.370s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1280686849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e01a939-7e09-4815-8079-e39a03bc05a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09b27286a764529b645292a86f1773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:37Z,use_quota=True,user_id='e92fcb99cdcd4907bfffcafd964963b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:52:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Creating volume 6e01a939-7e09-4815-8079-e39a03bc05a5 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:52:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:52:38 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:52:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6e01a939-7e09-4815-8079-e39a03bc05a5 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:38 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6e01a939-7e09-4815-8079-e39a03bc05a5 1073741824 Sep 23 12:52:38 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3305849a-7f71-4001-b6b5-c6b9a4f380a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5806ad9-80fd-493f-8da0-14f81a930896', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c656fc0-3d0b-4787-ac57-135b0bf104e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:38 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Volume volume-a5806ad9-80fd-493f-8da0-14f81a930896 (a5806ad9-80fd-493f-8da0-14f81a930896): created successfully Sep 23 12:52:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c656fc0-3d0b-4787-ac57-135b0bf104e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Flow 'volume_create_manager' (d42006b0-e15c-443b-961b-a155a3d8b232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:38 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d145a646-394a-4189-8898-d4532556fcbf tempest-CreateVolumesFromImageTest-457785607 None] Created volume successfully. Sep 23 12:52:39 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6e01a939-7e09-4815-8079-e39a03bc05a5 1073741824" returned: 0 in 0.400s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6e01a939-7e09-4815-8079-e39a03bc05a5 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:39 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6e01a939-7e09-4815-8079-e39a03bc05a5 Sep 23 12:52:39 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:39 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6e01a939-7e09-4815-8079-e39a03bc05a5" returned: 0 in 0.256s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.733s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-819660257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6bc9166-2be9-46d1-a46b-24236c089f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09b27286a764529b645292a86f1773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:37Z,use_quota=True,user_id='e92fcb99cdcd4907bfffcafd964963b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Creating volume b6bc9166-2be9-46d1-a46b-24236c089f56 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:52:39 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b6bc9166-2be9-46d1-a46b-24236c089f56 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b3354a-ebff-4676-9ba8-32845d5f086d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e01a939-7e09-4815-8079-e39a03bc05a5', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:39 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b6bc9166-2be9-46d1-a46b-24236c089f56 1073741824 Sep 23 12:52:39 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48c8e83-ed09-4251-9ba5-fa5db651b780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:39 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Volume volume-6e01a939-7e09-4815-8079-e39a03bc05a5 (6e01a939-7e09-4815-8079-e39a03bc05a5): created successfully Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48c8e83-ed09-4251-9ba5-fa5db651b780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Flow 'volume_create_manager' (087e4853-48d7-4509-bf34-dd091fda09f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:39 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-59345b88-3552-48cb-a893-2fd0dd9b1efb tempest-CreateVolumesFromImageTest-457785607 None] Created volume successfully. Sep 23 12:52:39 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b6bc9166-2be9-46d1-a46b-24236c089f56 1073741824" returned: 0 in 0.434s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b6bc9166-2be9-46d1-a46b-24236c089f56 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:39 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b6bc9166-2be9-46d1-a46b-24236c089f56 Sep 23 12:52:39 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:40 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b6bc9166-2be9-46d1-a46b-24236c089f56" returned: 0 in 0.237s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:52:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1210464-4e87-4827-8f14-bc8c28b7f54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6bc9166-2be9-46d1-a46b-24236c089f56', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6008a3b0-d525-439a-805a-d62b0775af88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:40 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Volume volume-b6bc9166-2be9-46d1-a46b-24236c089f56 (b6bc9166-2be9-46d1-a46b-24236c089f56): created successfully Sep 23 12:52:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6008a3b0-d525-439a-805a-d62b0775af88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Flow 'volume_create_manager' (1581c53d-2593-4642-94b3-de5077145cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:40 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d7f1a781-63c6-4f10-b319-0f5646ee74d9 tempest-CreateVolumesFromImageTest-457785607 None] Created volume successfully. Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "cinder-b6bc9166-2be9-46d1-a46b-24236c089f56-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-b6bc9166-2be9-46d1-a46b-24236c089f56-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "cinder-quobyte-b6bc9166-2be9-46d1-a46b-24236c089f56" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-quobyte-b6bc9166-2be9-46d1-a46b-24236c089f56" acquired by "delete_volume" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bf8f5c-2ab2-44cf-be74-20d7b51a434f]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b6bc9166-2be9-46d1-a46b-24236c089f56 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:41 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:52:41 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:41 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b6bc9166-2be9-46d1-a46b-24236c089f56 Sep 23 12:52:41 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:41 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.263s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:52:41 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b6bc9166-2be9-46d1-a46b-24236c089f56" returned: 0 in 0.400s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b6bc9166-2be9-46d1-a46b-24236c089f56 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:41 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b6bc9166-2be9-46d1-a46b-24236c089f56 Sep 23 12:52:41 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:42 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b6bc9166-2be9-46d1-a46b-24236c089f56" returned: 0 in 0.270s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-quobyte-b6bc9166-2be9-46d1-a46b-24236c089f56" released by "delete_volume" :: held 0.721s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] Created reservations ['9b9970ca-25a7-4d8a-a568-9f8cabf18a3a', '09e888a2-c906-4d99-9858-dedf97863723', 'f2a558f0-d5f1-4b80-bbfa-cc80c4ab43de', 'a35282ff-b770-41c2-b51b-714bad2b5237'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:42 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:52:42 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "cinder-6e01a939-7e09-4815-8079-e39a03bc05a5-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-6e01a939-7e09-4815-8079-e39a03bc05a5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:42 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.273s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:52:42 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] Deleted volume successfully. Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "cinder-quobyte-6e01a939-7e09-4815-8079-e39a03bc05a5" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7fdec6c7-6b08-4543-9838-c5bb12b6369b tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-b6bc9166-2be9-46d1-a46b-24236c089f56-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-quobyte-6e01a939-7e09-4815-8079-e39a03bc05a5" acquired by "delete_volume" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ac263c-4f54-42e4-ad02-3ac3cb1a933e]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6e01a939-7e09-4815-8079-e39a03bc05a5 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:42 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6e01a939-7e09-4815-8079-e39a03bc05a5 Sep 23 12:52:42 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:42 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6e01a939-7e09-4815-8079-e39a03bc05a5" returned: 0 in 0.355s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6e01a939-7e09-4815-8079-e39a03bc05a5 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:42 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6e01a939-7e09-4815-8079-e39a03bc05a5 Sep 23 12:52:42 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:43 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6e01a939-7e09-4815-8079-e39a03bc05a5" returned: 0 in 0.244s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-quobyte-6e01a939-7e09-4815-8079-e39a03bc05a5" released by "delete_volume" :: held 0.640s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:43 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] Created reservations ['a3c4e97b-b093-4ce4-ba41-18a78f1654b8', '9cff3bb2-ba0b-434d-b630-3f955a3e9139', '996811e2-e63e-4030-8e2e-157656b85dfd', 'b3768b00-f533-40bc-9f7c-6fee54b164aa'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:52:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:43 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:52:43 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:43 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.242s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:43 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:52:43 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] Deleted volume successfully. Sep 23 12:52:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f21ab1ef-8d4d-4b0f-aa16-a4df63f336ea tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-6e01a939-7e09-4815-8079-e39a03bc05a5-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "cinder-a5806ad9-80fd-493f-8da0-14f81a930896-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-a5806ad9-80fd-493f-8da0-14f81a930896-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "cinder-quobyte-a5806ad9-80fd-493f-8da0-14f81a930896" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-quobyte-a5806ad9-80fd-493f-8da0-14f81a930896" acquired by "delete_volume" :: waited 0.013s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:43 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7c1cbf-6707-4d0b-b448-8e771323e6e9]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:52:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a5806ad9-80fd-493f-8da0-14f81a930896 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:43 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a5806ad9-80fd-493f-8da0-14f81a930896 Sep 23 12:52:43 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:44 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a5806ad9-80fd-493f-8da0-14f81a930896" returned: 0 in 0.369s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a5806ad9-80fd-493f-8da0-14f81a930896 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:44 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a5806ad9-80fd-493f-8da0-14f81a930896 Sep 23 12:52:44 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:44 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a5806ad9-80fd-493f-8da0-14f81a930896" returned: 0 in 0.239s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-quobyte-a5806ad9-80fd-493f-8da0-14f81a930896" released by "delete_volume" :: held 0.648s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] Created reservations ['3f39b21a-10b2-4c6d-8531-e12bce37fb06', '79ce3fcb-557b-4793-8c4e-4738ee989ea1', '3f7566d9-8aa5-4920-969e-884051500711', '53e06815-b6d5-4608-9b74-8f7d45948507'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:44 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:52:44 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:44 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.248s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:52:44 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] Deleted volume successfully. Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-9e51ad13-b252-4eed-985d-b6601e68fef0 tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-a5806ad9-80fd-493f-8da0-14f81a930896-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "cinder-3e335287-5b34-4f4f-8c56-721e2ef5e6a3-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-3e335287-5b34-4f4f-8c56-721e2ef5e6a3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "cinder-quobyte-3e335287-5b34-4f4f-8c56-721e2ef5e6a3" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-quobyte-3e335287-5b34-4f4f-8c56-721e2ef5e6a3" acquired by "delete_volume" :: waited 0.014s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[73877092-2ac7-47a1-a698-7d8a76865c9a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:52:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e335287-5b34-4f4f-8c56-721e2ef5e6a3 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:44 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e335287-5b34-4f4f-8c56-721e2ef5e6a3 Sep 23 12:52:44 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:45 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e335287-5b34-4f4f-8c56-721e2ef5e6a3" returned: 0 in 0.368s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e335287-5b34-4f4f-8c56-721e2ef5e6a3 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:45 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e335287-5b34-4f4f-8c56-721e2ef5e6a3 Sep 23 12:52:45 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:45 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3e335287-5b34-4f4f-8c56-721e2ef5e6a3" returned: 0 in 0.239s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-quobyte-3e335287-5b34-4f4f-8c56-721e2ef5e6a3" released by "delete_volume" :: held 0.651s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:45 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] Created reservations ['f33bfb33-caf3-469e-ac42-f685b0f5f5a1', 'cb4db24f-1b7d-43e8-a489-e6a9114459d0', 'e89dde6f-c202-45d0-b42d-205ebd35ee95', 'a685a2ea-9668-4ab3-b83c-5437db236b16'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:52:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:45 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:52:45 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:45 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.253s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:45 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:52:45 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] Deleted volume successfully. Sep 23 12:52:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8970733e-d828-4d83-b7de-107041cdc60c tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-3e335287-5b34-4f4f-8c56-721e2ef5e6a3-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "cinder-d39d6d76-63f9-4100-80d9-f21af5b3941e-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-d39d6d76-63f9-4100-80d9-f21af5b3941e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "cinder-quobyte-d39d6d76-63f9-4100-80d9-f21af5b3941e" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-quobyte-d39d6d76-63f9-4100-80d9-f21af5b3941e" acquired by "delete_volume" :: waited 0.015s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:46 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae23e5be-c7c6-47e6-8d2a-997e81e3d44c]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:52:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d39d6d76-63f9-4100-80d9-f21af5b3941e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:46 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d39d6d76-63f9-4100-80d9-f21af5b3941e Sep 23 12:52:46 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:46 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d39d6d76-63f9-4100-80d9-f21af5b3941e" returned: 0 in 0.373s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d39d6d76-63f9-4100-80d9-f21af5b3941e {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:46 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d39d6d76-63f9-4100-80d9-f21af5b3941e Sep 23 12:52:46 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:46 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d39d6d76-63f9-4100-80d9-f21af5b3941e" returned: 0 in 0.260s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-quobyte-d39d6d76-63f9-4100-80d9-f21af5b3941e" released by "delete_volume" :: held 0.679s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:46 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] Created reservations ['fd9e2a3f-3ec1-408b-aba6-ee00127a440b', 'b5fa804b-8d41-4c65-b3c7-0925837e125f', '4f01fc8e-d1cb-431c-8956-51f058741251', '11e6579a-d614-4397-9cfd-4a0bed07b149'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:52:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:46 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:46 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:46 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:52:46 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:47 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.265s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:47 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:52:47 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] Deleted volume successfully. Sep 23 12:52:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f6ea3b3a-5980-4cc6-a89e-873b415b891c tempest-CreateVolumesFromImageTest-457785607 None] Lock "cinder-d39d6d76-63f9-4100-80d9-f21af5b3941e-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Flow 'volume_create_manager' (b8318eaf-45a4-4272-af08-e8da0c35855d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68fed863-86da-4a60-a606-bfd894403f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68fed863-86da-4a60-a606-bfd894403f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1842326819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c3d5373-bbbd-4bd5-9430-852171f4ccfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99a51f809af42b1bfa2a4bc3a07a32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:50Z,use_quota=True,user_id='6c677b1f31774b88855a9902977b550c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011146ee-5f3e-4ac7-adb8-b7d1dadf097b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011146ee-5f3e-4ac7-adb8-b7d1dadf097b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a0ed31-e4cf-41b6-aa16-50471a207e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a0ed31-e4cf-41b6-aa16-50471a207e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c3d5373-bbbd-4bd5-9430-852171f4ccfd', 'volume_name': 'volume-1c3d5373-bbbd-4bd5-9430-852171f4ccfd', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d44e4e-fe5d-44f2-b547-d0bb9c02b128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d44e4e-fe5d-44f2-b547-d0bb9c02b128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6618d8-de41-48fb-acb3-9e9dc9910018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:49 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Volume 1c3d5373-bbbd-4bd5-9430-852171f4ccfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c3d5373-bbbd-4bd5-9430-852171f4ccfd', 'volume_size': 1} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1842326819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c3d5373-bbbd-4bd5-9430-852171f4ccfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99a51f809af42b1bfa2a4bc3a07a32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:50Z,use_quota=True,user_id='6c677b1f31774b88855a9902977b550c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Creating volume 1c3d5373-bbbd-4bd5-9430-852171f4ccfd {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:52:49 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:52:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1c3d5373-bbbd-4bd5-9430-852171f4ccfd 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:49 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1c3d5373-bbbd-4bd5-9430-852171f4ccfd 1073741824 Sep 23 12:52:49 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:50 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1c3d5373-bbbd-4bd5-9430-852171f4ccfd 1073741824" returned: 0 in 0.417s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1c3d5373-bbbd-4bd5-9430-852171f4ccfd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:50 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1c3d5373-bbbd-4bd5-9430-852171f4ccfd Sep 23 12:52:50 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:50 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1c3d5373-bbbd-4bd5-9430-852171f4ccfd" returned: 0 in 0.244s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:52:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6618d8-de41-48fb-acb3-9e9dc9910018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c3d5373-bbbd-4bd5-9430-852171f4ccfd', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f7f7e2-8f92-45c7-a537-e5664636c5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:50 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Volume volume-1c3d5373-bbbd-4bd5-9430-852171f4ccfd (1c3d5373-bbbd-4bd5-9430-852171f4ccfd): created successfully Sep 23 12:52:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f7f7e2-8f92-45c7-a537-e5664636c5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Flow 'volume_create_manager' (b8318eaf-45a4-4272-af08-e8da0c35855d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:50 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-64d3d9bd-57c8-4ec4-a0db-82bca3d5dce4 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Created volume successfully. Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Flow 'volume_create_manager' (6a662b57-788d-461f-a116-887e07580a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8738d5-5241-4e5a-bf6f-b45c3004c018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8738d5-5241-4e5a-bf6f-b45c3004c018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1292114647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a751a3dd-bc94-4af0-ac02-f6e0bb88e16a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99a51f809af42b1bfa2a4bc3a07a32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:51Z,use_quota=True,user_id='6c677b1f31774b88855a9902977b550c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e846f5a-d3c8-4331-ba84-1ccbfe98c94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e846f5a-d3c8-4331-ba84-1ccbfe98c94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe35dd6-f6ff-4cbc-83e6-f2210e8a29ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe35dd6-f6ff-4cbc-83e6-f2210e8a29ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a751a3dd-bc94-4af0-ac02-f6e0bb88e16a', 'volume_name': 'volume-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4e8bee-f20e-4fe2-8d09-bb3c9b1cfb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4e8bee-f20e-4fe2-8d09-bb3c9b1cfb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3080b012-f68c-4f98-841a-2303cf3383f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:51 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Volume a751a3dd-bc94-4af0-ac02-f6e0bb88e16a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a', 'volume_size': 1} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1292114647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a751a3dd-bc94-4af0-ac02-f6e0bb88e16a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99a51f809af42b1bfa2a4bc3a07a32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:51Z,use_quota=True,user_id='6c677b1f31774b88855a9902977b550c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Creating volume a751a3dd-bc94-4af0-ac02-f6e0bb88e16a {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:52:51 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:51 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a 1073741824 Sep 23 12:52:51 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Flow 'volume_create_manager' (f4ea51ee-b437-42c3-a6b4-127e226f7561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e68c89-0f71-45b3-8b7f-979e47eed8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e68c89-0f71-45b3-8b7f-979e47eed8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-714665875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f11d1b-959f-46ca-971f-a9cfca1e0659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99a51f809af42b1bfa2a4bc3a07a32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:52Z,use_quota=True,user_id='6c677b1f31774b88855a9902977b550c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56fb2dd-849f-4171-839d-fb787b14ae30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56fb2dd-849f-4171-839d-fb787b14ae30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b2c460-72dd-414e-bf51-ae756b2d3388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b2c460-72dd-414e-bf51-ae756b2d3388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15f11d1b-959f-46ca-971f-a9cfca1e0659', 'volume_name': 'volume-15f11d1b-959f-46ca-971f-a9cfca1e0659', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641497d7-ed20-48f5-be9f-6e1883c7950e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641497d7-ed20-48f5-be9f-6e1883c7950e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77535eb-fcaf-42a1-b4b4-97cf799d6656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:51 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Volume 15f11d1b-959f-46ca-971f-a9cfca1e0659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15f11d1b-959f-46ca-971f-a9cfca1e0659', 'volume_size': 1} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:51 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a 1073741824" returned: 0 in 0.511s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:51 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a Sep 23 12:52:51 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:51 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Flow 'volume_create_manager' (21762670-66d6-4eb9-bcab-1d8e133133aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85d886a-83c8-4bb1-abaf-65b6a1ea797e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85d886a-83c8-4bb1-abaf-65b6a1ea797e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2020126325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99a51f809af42b1bfa2a4bc3a07a32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:52Z,use_quota=True,user_id='6c677b1f31774b88855a9902977b550c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ebc547-ad60-430c-8eb2-3237993650fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ebc547-ad60-430c-8eb2-3237993650fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680eea6d-58b9-41a2-b797-304e8314c838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680eea6d-58b9-41a2-b797-304e8314c838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f', 'volume_name': 'volume-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7d2022-4d88-4420-b34b-3d48ce54d944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7d2022-4d88-4420-b34b-3d48ce54d944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d693720b-cb8a-41ce-94e1-2fa00d4195e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:52 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Volume 456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f', 'volume_size': 1} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:52 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a" returned: 0 in 0.263s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.437s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-714665875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f11d1b-959f-46ca-971f-a9cfca1e0659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99a51f809af42b1bfa2a4bc3a07a32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:52Z,use_quota=True,user_id='6c677b1f31774b88855a9902977b550c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Creating volume 15f11d1b-959f-46ca-971f-a9cfca1e0659 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:52:52 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-15f11d1b-959f-46ca-971f-a9cfca1e0659 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:52 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-15f11d1b-959f-46ca-971f-a9cfca1e0659 1073741824 Sep 23 12:52:52 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3080b012-f68c-4f98-841a-2303cf3383f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa5a4c5-1f24-4a96-abf7-abeb82120a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:52 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Volume volume-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a (a751a3dd-bc94-4af0-ac02-f6e0bb88e16a): created successfully Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa5a4c5-1f24-4a96-abf7-abeb82120a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Flow 'volume_create_manager' (6a662b57-788d-461f-a116-887e07580a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:52 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f217a13b-9db3-4982-9cc9-eab3e58fa8a9 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Created volume successfully. Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Flow 'volume_create_manager' (3862fe69-26c8-466e-bb6b-a0a7e8689c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ed8e08-b59a-4b9e-a2b3-2afe48daf377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ed8e08-b59a-4b9e-a2b3-2afe48daf377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-345496104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=655fe753-6355-4a59-8a1e-fdc23473a2ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99a51f809af42b1bfa2a4bc3a07a32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:52Z,use_quota=True,user_id='6c677b1f31774b88855a9902977b550c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20e850b-01ea-4892-8d46-354f59464370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20e850b-01ea-4892-8d46-354f59464370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8021735f-3d48-4d8e-a4ac-4afbf84207ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8021735f-3d48-4d8e-a4ac-4afbf84207ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '655fe753-6355-4a59-8a1e-fdc23473a2ce', 'volume_name': 'volume-655fe753-6355-4a59-8a1e-fdc23473a2ce', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6651d576-6db7-46e7-87f4-52f0cb1a61d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6651d576-6db7-46e7-87f4-52f0cb1a61d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94afab2e-96b9-4237-87ba-27e5ef8c1ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:52 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Volume 655fe753-6355-4a59-8a1e-fdc23473a2ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-655fe753-6355-4a59-8a1e-fdc23473a2ce', 'volume_size': 1} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:52 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-15f11d1b-959f-46ca-971f-a9cfca1e0659 1073741824" returned: 0 in 0.532s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-15f11d1b-959f-46ca-971f-a9cfca1e0659 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:52 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-15f11d1b-959f-46ca-971f-a9cfca1e0659 Sep 23 12:52:52 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Flow 'volume_create_manager' (4fd42560-6ae4-4ec4-be77-158fcad99c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed920d5-6553-47b2-a6ae-82cc5b19f768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed920d5-6553-47b2-a6ae-82cc5b19f768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1753209144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2597ab-74ea-49b8-a27e-e7a8ac9386aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99a51f809af42b1bfa2a4bc3a07a32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:53Z,use_quota=True,user_id='6c677b1f31774b88855a9902977b550c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8215c072-0994-467b-9f65-cc0a605bd357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8215c072-0994-467b-9f65-cc0a605bd357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d1dbc7-5d63-42ca-b764-c55ba8f310cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d1dbc7-5d63-42ca-b764-c55ba8f310cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d2597ab-74ea-49b8-a27e-e7a8ac9386aa', 'volume_name': 'volume-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b89b1ab6-460a-488c-9fc7-f54c0f0f9f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b89b1ab6-460a-488c-9fc7-f54c0f0f9f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436d10ce-ac91-490f-840f-f527ad3bd645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:52 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Volume 2d2597ab-74ea-49b8-a27e-e7a8ac9386aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa', 'volume_size': 1} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:52 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-15f11d1b-959f-46ca-971f-a9cfca1e0659" returned: 0 in 0.236s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.874s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2020126325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99a51f809af42b1bfa2a4bc3a07a32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:52Z,use_quota=True,user_id='6c677b1f31774b88855a9902977b550c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Creating volume 456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:52:52 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77535eb-fcaf-42a1-b4b4-97cf799d6656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f11d1b-959f-46ca-971f-a9cfca1e0659', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:52 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f 1073741824 Sep 23 12:52:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (212c67db-bb63-4a77-80f7-3c4b3a2e3b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:52 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:53 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Volume volume-15f11d1b-959f-46ca-971f-a9cfca1e0659 (15f11d1b-959f-46ca-971f-a9cfca1e0659): created successfully Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (212c67db-bb63-4a77-80f7-3c4b3a2e3b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Flow 'volume_create_manager' (f4ea51ee-b437-42c3-a6b4-127e226f7561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:53 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-9c3f7c63-b0da-483e-9af5-e7a029ef618a tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Created volume successfully. Sep 23 12:52:53 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f 1073741824" returned: 0 in 0.410s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:53 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f Sep 23 12:52:53 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:53 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f" returned: 0 in 0.245s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.196s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-345496104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=655fe753-6355-4a59-8a1e-fdc23473a2ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99a51f809af42b1bfa2a4bc3a07a32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:52Z,use_quota=True,user_id='6c677b1f31774b88855a9902977b550c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Creating volume 655fe753-6355-4a59-8a1e-fdc23473a2ce {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:52:53 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-655fe753-6355-4a59-8a1e-fdc23473a2ce 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:53 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-655fe753-6355-4a59-8a1e-fdc23473a2ce 1073741824 Sep 23 12:52:53 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d693720b-cb8a-41ce-94e1-2fa00d4195e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9344da33-efe7-4ce7-9486-03ff5f4f3937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:53 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Volume volume-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f (456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f): created successfully Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9344da33-efe7-4ce7-9486-03ff5f4f3937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Flow 'volume_create_manager' (21762670-66d6-4eb9-bcab-1d8e133133aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:53 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-e0de1627-478d-4390-9008-58595fa1fb46 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Created volume successfully. Sep 23 12:52:54 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-655fe753-6355-4a59-8a1e-fdc23473a2ce 1073741824" returned: 0 in 0.434s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-655fe753-6355-4a59-8a1e-fdc23473a2ce {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:54 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-655fe753-6355-4a59-8a1e-fdc23473a2ce Sep 23 12:52:54 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:54 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-655fe753-6355-4a59-8a1e-fdc23473a2ce" returned: 0 in 0.241s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.491s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1753209144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2597ab-74ea-49b8-a27e-e7a8ac9386aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99a51f809af42b1bfa2a4bc3a07a32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:52:53Z,use_quota=True,user_id='6c677b1f31774b88855a9902977b550c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Creating volume 2d2597ab-74ea-49b8-a27e-e7a8ac9386aa {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:52:54 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94afab2e-96b9-4237-87ba-27e5ef8c1ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-655fe753-6355-4a59-8a1e-fdc23473a2ce', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:54 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa 1073741824 Sep 23 12:52:54 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ad5b70-8df7-4780-8998-b036b8b8582d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:54 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Volume volume-655fe753-6355-4a59-8a1e-fdc23473a2ce (655fe753-6355-4a59-8a1e-fdc23473a2ce): created successfully Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ad5b70-8df7-4780-8998-b036b8b8582d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Flow 'volume_create_manager' (3862fe69-26c8-466e-bb6b-a0a7e8689c47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:54 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-8a25a742-0d31-4d56-ba81-4c51c054b2a3 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Created volume successfully. Sep 23 12:52:54 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa 1073741824" returned: 0 in 0.422s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:54 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa Sep 23 12:52:54 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:55 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa" returned: 0 in 0.253s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:52:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436d10ce-ac91-490f-840f-f527ad3bd645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9ec9f1-3007-4042-9f40-2b7c5dfd4d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:52:55 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Volume volume-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa (2d2597ab-74ea-49b8-a27e-e7a8ac9386aa): created successfully Sep 23 12:52:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9ec9f1-3007-4042-9f40-2b7c5dfd4d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:52:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Flow 'volume_create_manager' (4fd42560-6ae4-4ec4-be77-158fcad99c13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:52:55 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-75722884-a489-4eaa-b9f2-9197cee75ca8 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Created volume successfully. Sep 23 12:52:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "cinder-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "cinder-quobyte-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-quobyte-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa" acquired by "delete_volume" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:56 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cf57d6-10ab-42be-9807-43668d2558d3]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:52:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:56 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa Sep 23 12:52:56 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:56 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa" returned: 0 in 0.367s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:56 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa Sep 23 12:52:56 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:56 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa" returned: 0 in 0.250s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-quobyte-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa" released by "delete_volume" :: held 0.660s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:56 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Created reservations ['d67cfd7b-6ae9-422a-bf33-7ad9126998c1', '62aeb76b-e0e1-4e01-abb5-02ae039e1ea2', '87433a11-3750-4531-88db-8951191abcce', '67d62185-0ed7-4568-8511-9a721249804c'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:52:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:57 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:52:57 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:57 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.288s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:57 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:52:57 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Deleted volume successfully. Sep 23 12:52:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-7de0da34-f69c-4536-a750-7c0c956847fd tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-2d2597ab-74ea-49b8-a27e-e7a8ac9386aa-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "cinder-655fe753-6355-4a59-8a1e-fdc23473a2ce-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-655fe753-6355-4a59-8a1e-fdc23473a2ce-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "cinder-quobyte-655fe753-6355-4a59-8a1e-fdc23473a2ce" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-quobyte-655fe753-6355-4a59-8a1e-fdc23473a2ce" acquired by "delete_volume" :: waited 0.013s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:57 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2545889a-0c9f-4a99-a4ac-5f142efb4198]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:52:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-655fe753-6355-4a59-8a1e-fdc23473a2ce {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:57 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-655fe753-6355-4a59-8a1e-fdc23473a2ce Sep 23 12:52:57 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:57 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-655fe753-6355-4a59-8a1e-fdc23473a2ce" returned: 0 in 0.370s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-655fe753-6355-4a59-8a1e-fdc23473a2ce {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:57 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-655fe753-6355-4a59-8a1e-fdc23473a2ce Sep 23 12:52:57 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:58 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-655fe753-6355-4a59-8a1e-fdc23473a2ce" returned: 0 in 0.237s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-quobyte-655fe753-6355-4a59-8a1e-fdc23473a2ce" released by "delete_volume" :: held 0.646s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Created reservations ['4761ee14-66c7-421b-9bb8-99509ddfd3a7', '302cbe3e-d49f-4dbe-bb50-931e8eaaf676', '730416d0-c819-4f95-b3ad-2caf357d8ce8', '226d7f3b-e84e-46aa-9c15-eb7a2b37718f'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:58 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:52:58 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:58 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.235s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:52:58 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Deleted volume successfully. Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c1adc7dd-7d57-48b6-a69e-67e0c77e8f54 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-655fe753-6355-4a59-8a1e-fdc23473a2ce-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "cinder-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "cinder-quobyte-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-quobyte-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f" acquired by "delete_volume" :: waited 0.014s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9021634-8408-4b23-a52e-b342911f2472]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:58 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f Sep 23 12:52:58 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:58 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f" returned: 0 in 0.366s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:58 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f Sep 23 12:52:58 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:59 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f" returned: 0 in 0.242s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-quobyte-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f" released by "delete_volume" :: held 0.648s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:59 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Created reservations ['13506422-6bda-496a-89e2-9a85404bac76', '2a4aac75-83c5-491f-8929-d3cc7c50a950', '5e87d3c1-d410-4c79-9e6e-1f2ce2cfe644', 'f8d092aa-abd5-432f-ad3d-549e9b768d94'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:52:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:52:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:52:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:52:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:52:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:52:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:59 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:52:59 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:52:59 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Sep 23 12:52:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.236s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:52:59 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:52:59 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Deleted volume successfully. Sep 23 12:52:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-db3c06ef-63f5-4c5b-bc9e-31e3ec74058f tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-456cd8e6-1f0e-4f3a-b0fc-549db1c4b60f-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:52:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "cinder-15f11d1b-959f-46ca-971f-a9cfca1e0659-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-15f11d1b-959f-46ca-971f-a9cfca1e0659-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "cinder-quobyte-15f11d1b-959f-46ca-971f-a9cfca1e0659" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:52:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-quobyte-15f11d1b-959f-46ca-971f-a9cfca1e0659" acquired by "delete_volume" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:52:59 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0a4e6c-687c-418e-9be6-3852d1f23257]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:52:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-15f11d1b-959f-46ca-971f-a9cfca1e0659 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:52:59 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-15f11d1b-959f-46ca-971f-a9cfca1e0659 Sep 23 12:52:59 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:00 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-15f11d1b-959f-46ca-971f-a9cfca1e0659" returned: 0 in 0.382s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-15f11d1b-959f-46ca-971f-a9cfca1e0659 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:00 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-15f11d1b-959f-46ca-971f-a9cfca1e0659 Sep 23 12:53:00 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:00 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-15f11d1b-959f-46ca-971f-a9cfca1e0659" returned: 0 in 0.237s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-quobyte-15f11d1b-959f-46ca-971f-a9cfca1e0659" released by "delete_volume" :: held 0.659s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Created reservations ['865f0eb8-f30c-4a49-a450-ae1ba80c0b5b', '7cf16932-8838-4760-92af-1647ea07e2fe', 'b6c2019d-22b2-47bd-a578-8b9269a8dddc', '5e5ce254-51a9-4bb9-8b97-7dd414b4d08c'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:00 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:53:00 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:00 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.266s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:53:00 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Deleted volume successfully. Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a4983fc9-b96a-42e5-8749-a5f19290a0f2 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-15f11d1b-959f-46ca-971f-a9cfca1e0659-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "cinder-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "cinder-quobyte-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-quobyte-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a" acquired by "delete_volume" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9416c46-c4e7-454d-a088-a5651da04dc0]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:01 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a Sep 23 12:53:01 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:01 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a" returned: 0 in 0.371s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:01 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a Sep 23 12:53:01 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:01 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a" returned: 0 in 0.237s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-quobyte-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a" released by "delete_volume" :: held 0.646s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:01 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Created reservations ['c31b33a2-661f-4104-9374-7332524271b2', '52db1e0e-692b-4d9c-8dc5-8f5dbad7fe79', 'de37cb6e-6c39-450d-bd36-42b74dda449a', '8b62734d-adcb-41ef-a321-37bfb8b9417f'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:53:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:01 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:53:01 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:01 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.269s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:01 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:53:01 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Deleted volume successfully. Sep 23 12:53:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-93d29409-b7b1-4ad0-9aaa-5f56f87ea403 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-a751a3dd-bc94-4af0-ac02-f6e0bb88e16a-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "cinder-1c3d5373-bbbd-4bd5-9430-852171f4ccfd-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-1c3d5373-bbbd-4bd5-9430-852171f4ccfd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "cinder-quobyte-1c3d5373-bbbd-4bd5-9430-852171f4ccfd" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-quobyte-1c3d5373-bbbd-4bd5-9430-852171f4ccfd" acquired by "delete_volume" :: waited 0.014s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:02 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffa23cf-6ef8-456e-becc-03bffcb81fc3]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1c3d5373-bbbd-4bd5-9430-852171f4ccfd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:02 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1c3d5373-bbbd-4bd5-9430-852171f4ccfd Sep 23 12:53:02 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:02 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1c3d5373-bbbd-4bd5-9430-852171f4ccfd" returned: 0 in 0.348s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1c3d5373-bbbd-4bd5-9430-852171f4ccfd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:02 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1c3d5373-bbbd-4bd5-9430-852171f4ccfd Sep 23 12:53:02 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:02 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1c3d5373-bbbd-4bd5-9430-852171f4ccfd" returned: 0 in 0.248s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-quobyte-1c3d5373-bbbd-4bd5-9430-852171f4ccfd" released by "delete_volume" :: held 0.634s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:02 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Created reservations ['e1f0bec5-f456-4437-ab60-d737a2c9cfd0', '6eb0a13e-41e3-4853-a95c-5c54251bbc00', 'ae10ccf4-6ef3-49d0-8f66-5cfc846fd6f3', '7769e853-5048-4dc5-85e0-686c01f9d4c1'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:53:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:02 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:53:02 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:03 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.243s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:03 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:53:03 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Deleted volume successfully. Sep 23 12:53:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-50ac6872-44a1-46b6-af38-2f2d8fe23160 tempest-CreateVolumesFromSourceVolumeTest-319157171 None] Lock "cinder-1c3d5373-bbbd-4bd5-9430-852171f4ccfd-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:12 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=99,cinder:UPDATE=154,cinder:INSERT=31,cinder:DELETE=13 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:53:13 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=106,cinder:UPDATE=127,cinder:INSERT=32,cinder:DELETE=11 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:53:23 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Flow 'volume_create_manager' (d9993a38-09ab-4148-b77a-e4f6442d8df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ac99a5-7f1a-46a5-9bf9-b835e7df6cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ac99a5-7f1a-46a5-9bf9-b835e7df6cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1793982281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1ba096-2b41-4739-8dfd-44b2a8b01487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0fd194083434f41b11cdd75e2a50bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:24Z,use_quota=True,user_id='df31cf4f10ef40f4934a0de2de03ace5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04057b89-1511-4cd7-b907-090c2ddce348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04057b89-1511-4cd7-b907-090c2ddce348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6611b8ed-9db4-4866-b9d2-a359379cc2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6611b8ed-9db4-4866-b9d2-a359379cc2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f1ba096-2b41-4739-8dfd-44b2a8b01487', 'volume_name': 'volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346b73b2-8220-4768-bb5a-f34d87fb52c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346b73b2-8220-4768-bb5a-f34d87fb52c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79961f7b-9c48-45a3-b277-ee43a99f1022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:24 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Volume 2f1ba096-2b41-4739-8dfd-44b2a8b01487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487', 'volume_size': 1} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1793982281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1ba096-2b41-4739-8dfd-44b2a8b01487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0fd194083434f41b11cdd75e2a50bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:24Z,use_quota=True,user_id='df31cf4f10ef40f4934a0de2de03ace5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Creating volume 2f1ba096-2b41-4739-8dfd-44b2a8b01487 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:24 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:24 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 1073741824 Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:24 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Flow 'volume_create_manager' (b2772cea-bcb5-4cb7-8df3-6450ae5e4a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905a836d-f9e5-4313-b405-09c137c5bee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905a836d-f9e5-4313-b405-09c137c5bee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1709506426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ddccaa-1502-4608-89bc-d6f4264e6274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200a2157bd6249e49c1e62744fcfb381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:24Z,use_quota=True,user_id='5afcb0c87273431691019cf8af6e2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52f2ed6-3c93-43f7-8941-e6eefeaab197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52f2ed6-3c93-43f7-8941-e6eefeaab197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3c15d8-07a0-4c61-bf86-12e9c2da2144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3c15d8-07a0-4c61-bf86-12e9c2da2144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59ddccaa-1502-4608-89bc-d6f4264e6274', 'volume_name': 'volume-59ddccaa-1502-4608-89bc-d6f4264e6274', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41df187b-0526-48e0-8466-2187811e7391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41df187b-0526-48e0-8466-2187811e7391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b25dda-9b2b-4419-9166-288b10128b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:24 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Volume 59ddccaa-1502-4608-89bc-d6f4264e6274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59ddccaa-1502-4608-89bc-d6f4264e6274', 'volume_size': 1} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Flow 'volume_create_manager' (2a16f8f0-2c1b-4253-8f43-872f3f577366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77dfdf6-54c9-40e1-baf5-6f40f295a011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77dfdf6-54c9-40e1-baf5-6f40f295a011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1319823344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33439cad76484462b1fd56295a62e643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:24Z,use_quota=True,user_id='31f45d14ebe54d9f9ed8612d05b258c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3022d538-22d8-4d2c-9da1-2391c1651463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3022d538-22d8-4d2c-9da1-2391c1651463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a9fabe-1bb5-4a73-898b-d9bfb2d2dc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a9fabe-1bb5-4a73-898b-d9bfb2d2dc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b', 'volume_name': 'volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4076eead-158a-412f-8e8c-009a8f80c898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4076eead-158a-412f-8e8c-009a8f80c898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d305e5-a911-40da-9265-dc57fd9aea1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:24 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Volume 667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b', 'volume_size': 1} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:24 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 1073741824" returned: 0 in 0.583s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:24 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 Sep 23 12:53:24 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:24 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487" returned: 0 in 0.261s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.743s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1709506426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ddccaa-1502-4608-89bc-d6f4264e6274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200a2157bd6249e49c1e62744fcfb381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:24Z,use_quota=True,user_id='5afcb0c87273431691019cf8af6e2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Creating volume 59ddccaa-1502-4608-89bc-d6f4264e6274 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:24 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-59ddccaa-1502-4608-89bc-d6f4264e6274 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79961f7b-9c48-45a3-b277-ee43a99f1022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e34b69-c54d-4eca-8004-b07bd850469c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:25 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-59ddccaa-1502-4608-89bc-d6f4264e6274 1073741824 Sep 23 12:53:25 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:25 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Volume volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 (2f1ba096-2b41-4739-8dfd-44b2a8b01487): created successfully Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e34b69-c54d-4eca-8004-b07bd850469c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Flow 'volume_create_manager' (d9993a38-09ab-4148-b77a-e4f6442d8df9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:25 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d4a3119f-fa18-4c03-8de7-fb3463549034 tempest-VolumeDependencyTests-619904691 None] Created volume successfully. Sep 23 12:53:25 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-59ddccaa-1502-4608-89bc-d6f4264e6274 1073741824" returned: 0 in 0.486s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-59ddccaa-1502-4608-89bc-d6f4264e6274 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:25 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-59ddccaa-1502-4608-89bc-d6f4264e6274 Sep 23 12:53:25 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:25 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-59ddccaa-1502-4608-89bc-d6f4264e6274" returned: 0 in 0.261s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.160s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1319823344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33439cad76484462b1fd56295a62e643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:24Z,use_quota=True,user_id='31f45d14ebe54d9f9ed8612d05b258c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Creating volume 667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:25 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:25 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b 1073741824 Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b25dda-9b2b-4419-9166-288b10128b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59ddccaa-1502-4608-89bc-d6f4264e6274', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:25 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75297bb3-d3fc-49d3-9416-f7fad1da428c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:25 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Volume volume-59ddccaa-1502-4608-89bc-d6f4264e6274 (59ddccaa-1502-4608-89bc-d6f4264e6274): created successfully Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75297bb3-d3fc-49d3-9416-f7fad1da428c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Flow 'volume_create_manager' (b2772cea-bcb5-4cb7-8df3-6450ae5e4a72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:25 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-dd25f192-127c-493e-9391-0507d2d6868c tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Created volume successfully. Sep 23 12:53:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c7c1c1a5-8ce2-463b-af47-560a7f837802 tempest-VolumeDependencyTests-619904691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:26 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b 1073741824" returned: 0 in 0.511s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:26 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b Sep 23 12:53:26 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:26 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b" returned: 0 in 0.260s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c7c1c1a5-8ce2-463b-af47-560a7f837802 tempest-VolumeDependencyTests-619904691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.621s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c7c1c1a5-8ce2-463b-af47-560a7f837802 tempest-VolumeDependencyTests-619904691 None] Creating offline snapshot a560d411-c33b-4807-8674-c9ff074eb1ab of volume 2f1ba096-2b41-4739-8dfd-44b2a8b01487 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:53:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d305e5-a911-40da-9265-dc57fd9aea1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f59fb9-5e5d-4e06-afc5-bce10b5f67c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:26 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Volume volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b (667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b): created successfully Sep 23 12:53:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f59fb9-5e5d-4e06-afc5-bce10b5f67c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Flow 'volume_create_manager' (2a16f8f0-2c1b-4253-8f43-872f3f577366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:26 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcf4b53-c867-479e-9967-da7a2497e584]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c7c1c1a5-8ce2-463b-af47-560a7f837802 tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:26 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d4ccfe8e-3140-4d0f-84c4-5f9a8e52fe78 tempest-CreateVolumesFromSnapshotTest-92252839 None] Created volume successfully. Sep 23 12:53:26 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 Sep 23 12:53:26 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:27 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c7c1c1a5-8ce2-463b-af47-560a7f837802 tempest-VolumeDependencyTests-619904691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487" returned: 0 in 0.423s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c7c1c1a5-8ce2-463b-af47-560a7f837802 tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:27 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab 1G Sep 23 12:53:27 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:27 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Flow 'volume_create_manager' (b971f826-74b2-489f-87c7-e7fa02d4758c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e1502f-dd72-42d6-a7b8-d6c5c48db832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e1502f-dd72-42d6-a7b8-d6c5c48db832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-79369817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d70aaefe-87b7-46cd-b4ef-19d2eb900420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200a2157bd6249e49c1e62744fcfb381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:27Z,use_quota=True,user_id='5afcb0c87273431691019cf8af6e2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf6e888-1940-4c49-86a7-fff72da0e7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf6e888-1940-4c49-86a7-fff72da0e7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e440c871-98f5-4e7e-83cf-d23341be92f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e440c871-98f5-4e7e-83cf-d23341be92f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd70aaefe-87b7-46cd-b4ef-19d2eb900420', 'volume_name': 'volume-d70aaefe-87b7-46cd-b4ef-19d2eb900420', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d9c71f-603e-4989-beb5-6351c75ac0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d9c71f-603e-4989-beb5-6351c75ac0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da3c3ca-c114-47c7-b116-dc0e8c48825e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:27 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Volume d70aaefe-87b7-46cd-b4ef-19d2eb900420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d70aaefe-87b7-46cd-b4ef-19d2eb900420', 'volume_size': 1} Sep 23 12:53:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:27 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c7c1c1a5-8ce2-463b-af47-560a7f837802 tempest-VolumeDependencyTests-619904691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab 1G" returned: 0 in 0.634s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c7c1c1a5-8ce2-463b-af47-560a7f837802 tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:27 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab Sep 23 12:53:27 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:28 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c7c1c1a5-8ce2-463b-af47-560a7f837802 tempest-VolumeDependencyTests-619904691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab" returned: 0 in 0.363s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:28 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-c7c1c1a5-8ce2-463b-af47-560a7f837802 tempest-VolumeDependencyTests-619904691 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab is being set with open permissions: ugo+rw Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c7c1c1a5-8ce2-463b-af47-560a7f837802 tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:28 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab Sep 23 12:53:28 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Flow 'volume_create_manager' (6caab932-3910-4e7d-8e43-2537df51a132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4f8517-c14d-485b-ba20-cb73ccb296cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4f8517-c14d-485b-ba20-cb73ccb296cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d117103-0b1a-4ce6-8c2a-ba833de8cce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3989466435584cc5be3e08e8e1f64060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:28Z,use_quota=True,user_id='6c9ce68a1d684279ae9760404ee502da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a8eeb1c-eff2-4232-969b-5a504f79480c),volume_type_id=2a8eeb1c-eff2-4232-969b-5a504f79480c)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3068911a-a615-4523-a2e3-a76ebb5fb45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3068911a-a615-4523-a2e3-a76ebb5fb45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d7fd54-ff0d-4909-9d9b-61e89bbeb58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.image.glance [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Creating Keystone auth plugin from conf {{(pid=86085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7ff2dc8e-7654-4fba-b364-5d2d3840bcb1 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Flow 'volume_create_manager' (8d2be40f-165d-4dfe-ad6d-22753ff97534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b2b8a2-8094-491e-850b-a0b3bf99a5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b2b8a2-8094-491e-850b-a0b3bf99a5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1097012203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e7763b-cb8f-49fc-9423-12c3d028e09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200a2157bd6249e49c1e62744fcfb381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:28Z,use_quota=True,user_id='5afcb0c87273431691019cf8af6e2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315a4ba9-eb7f-4a89-9835-5b4e5b3abfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315a4ba9-eb7f-4a89-9835-5b4e5b3abfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e48b48-f6c7-45be-85e9-41572b99ac1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e48b48-f6c7-45be-85e9-41572b99ac1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35e7763b-cb8f-49fc-9423-12c3d028e09b', 'volume_name': 'volume-35e7763b-cb8f-49fc-9423-12c3d028e09b', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bebcdfa1-1ca5-4189-81dd-775911852fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bebcdfa1-1ca5-4189-81dd-775911852fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44587c3-0b0a-4043-8600-aee1a9b208c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Volume 35e7763b-cb8f-49fc-9423-12c3d028e09b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35e7763b-cb8f-49fc-9423-12c3d028e09b', 'volume_size': 1} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c7c1c1a5-8ce2-463b-af47-560a7f837802 tempest-VolumeDependencyTests-619904691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab" returned: 0 in 0.391s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Flow 'volume_create_manager' (959d3d5d-e533-4955-be8a-a238f3652faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635ddf17-0b94-4f90-ab87-62a84395804e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635ddf17-0b94-4f90-ab87-62a84395804e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-449862176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa3e1ed-26ba-4a10-91e1-1314a5f48e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200a2157bd6249e49c1e62744fcfb381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:28Z,use_quota=True,user_id='5afcb0c87273431691019cf8af6e2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2da7db-f96d-4213-ad14-59b23cb7d91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2da7db-f96d-4213-ad14-59b23cb7d91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459373a8-f571-4f6a-8596-379a3ee7768a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459373a8-f571-4f6a-8596-379a3ee7768a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aa3e1ed-26ba-4a10-91e1-1314a5f48e44', 'volume_name': 'volume-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64279163-5c93-4f2c-a7ee-7b0210396035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64279163-5c93-4f2c-a7ee-7b0210396035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db3f2d2-2f70-453c-ace4-9b0fc4e9270e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Volume 4aa3e1ed-26ba-4a10-91e1-1314a5f48e44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44', 'volume_size': 1} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c7c1c1a5-8ce2-463b-af47-560a7f837802 tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:28 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.info Sep 23 12:53:28 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d7fd54-ff0d-4909-9d9b-61e89bbeb58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1d117103-0b1a-4ce6-8c2a-ba833de8cce6', 'volume_name': 'volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6', 'volume_size': 1, 'image_id': '529504eb-0715-404f-8134-e483d6329cc0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/529504eb-0715-404f-8134-e483d6329cc0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '54da53d82c91d1fe83f394fd554dd048', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3989466435584cc5be3e08e8e1f64060', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '204aa822e6fdf30ab404e41f0351bc68bd822c2de84fe5fcb9213da4a335795a08aabf3164a4e4356e6efdf582553a7ddd805b982be4621057a1a6b77d5c3d20', 'id': '529504eb-0715-404f-8134-e483d6329cc0', 'created_at': datetime.datetime(2026, 9, 23, 10, 53, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 53, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/529504eb-0715-404f-8134-e483d6329cc0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc80b728-c779-49c1-8464-51f97776dc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc80b728-c779-49c1-8464-51f97776dc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa82b240-05a4-4e87-86ca-657323588d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Volume 1d117103-0b1a-4ce6-8c2a-ba833de8cce6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6', 'volume_size': 1, 'image_id': '529504eb-0715-404f-8134-e483d6329cc0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/529504eb-0715-404f-8134-e483d6329cc0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '54da53d82c91d1fe83f394fd554dd048', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3989466435584cc5be3e08e8e1f64060', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '204aa822e6fdf30ab404e41f0351bc68bd822c2de84fe5fcb9213da4a335795a08aabf3164a4e4356e6efdf582553a7ddd805b982be4621057a1a6b77d5c3d20', 'id': '529504eb-0715-404f-8134-e483d6329cc0', 'created_at': datetime.datetime(2026, 9, 23, 10, 53, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 53, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/529504eb-0715-404f-8134-e483d6329cc0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Trying to clone 1d117103-0b1a-4ce6-8c2a-ba833de8cce6 from image 529504eb-0715-404f-8134-e483d6329cc0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/529504eb-0715-404f-8134-e483d6329cc0', 'metadata': {}}]). {{(pid=86085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Flow 'volume_create_manager' (d951eaac-0773-44ed-9bfe-b79d0e6e5b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d14a06d-936a-4859-8cee-249e308ae015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d14a06d-936a-4859-8cee-249e308ae015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-828410461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5598352a-748e-40c5-b4e2-34bf6507f4d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200a2157bd6249e49c1e62744fcfb381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:29Z,use_quota=True,user_id='5afcb0c87273431691019cf8af6e2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57fc9dd-ab85-424b-a38a-2f5eafcbb89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57fc9dd-ab85-424b-a38a-2f5eafcbb89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25a20cb-0562-4482-9b77-cf272cd8ca26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25a20cb-0562-4482-9b77-cf272cd8ca26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5598352a-748e-40c5-b4e2-34bf6507f4d5', 'volume_name': 'volume-5598352a-748e-40c5-b4e2-34bf6507f4d5', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62a56fb-6820-49a9-a5a8-23d207689f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62a56fb-6820-49a9-a5a8-23d207689f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec74e69a-617e-4631-b362-8614c2d5d186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:28 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Volume 5598352a-748e-40c5-b4e2-34bf6507f4d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5598352a-748e-40c5-b4e2-34bf6507f4d5', 'volume_size': 1} Sep 23 12:53:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:28 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c7c1c1a5-8ce2-463b-af47-560a7f837802 tempest-VolumeDependencyTests-619904691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.info" returned: 0 in 0.363s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:29 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-c7c1c1a5-8ce2-463b-af47-560a7f837802 tempest-VolumeDependencyTests-619904691 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.info is being set with open permissions: ugo+rw Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c7c1c1a5-8ce2-463b-af47-560a7f837802 tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 12:53:29 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Image download 0.00 MB at 0.00 MB/s Sep 23 12:53:29 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.info Sep 23 12:53:29 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b7f9cd-b902-4020-b03b-a94c2e4cd605]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:29 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD Sep 23 12:53:29 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Flow 'volume_create_manager' (91baec22-b68b-48c6-b34d-47c04212db5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb169154-5ce1-4a9a-b4c8-e82398411995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:29 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c7c1c1a5-8ce2-463b-af47-560a7f837802 tempest-VolumeDependencyTests-619904691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.info" returned: 0 in 0.367s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c7c1c1a5-8ce2-463b-af47-560a7f837802 tempest-VolumeDependencyTests-619904691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.781s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.708s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-79369817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d70aaefe-87b7-46cd-b4ef-19d2eb900420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200a2157bd6249e49c1e62744fcfb381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:27Z,use_quota=True,user_id='5afcb0c87273431691019cf8af6e2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Creating volume d70aaefe-87b7-46cd-b4ef-19d2eb900420 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:29 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d70aaefe-87b7-46cd-b4ef-19d2eb900420 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb169154-5ce1-4a9a-b4c8-e82398411995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-415380350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200a2157bd6249e49c1e62744fcfb381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:29Z,use_quota=True,user_id='5afcb0c87273431691019cf8af6e2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ced5b26-4168-4bac-80e3-1254ab31f710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ced5b26-4168-4bac-80e3-1254ab31f710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:29 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d70aaefe-87b7-46cd-b4ef-19d2eb900420 1073741824 Sep 23 12:53:29 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4e4641-4520-4b60-af22-5c04f627b93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4e4641-4520-4b60-af22-5c04f627b93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096', 'volume_name': 'volume-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c4dfd5-aac2-44ae-9c14-6c64b513423a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:29 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c4dfd5-aac2-44ae-9c14-6c64b513423a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6af03a-a5fa-4ac5-b921-51700368e284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:29 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Volume 6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096', 'volume_size': 1} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD" returned: 0 in 0.396s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:29 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-c7c1c1a5-8ce2-463b-af47-560a7f837802 tempest-VolumeDependencyTests-619904691 None] Create snapshot completed successfully Sep 23 12:53:29 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD Sep 23 12:53:29 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:29 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD" returned: 1 in 0.383s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Temporary image 529504eb-0715-404f-8134-e483d6329cc0 is fetched for user 6c9ce68a1d684279ae9760404ee502da. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 12:53:29 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d70aaefe-87b7-46cd-b4ef-19d2eb900420 1073741824" returned: 0 in 0.532s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe48694-ca9f-4f4d-8dd1-8cac878ea3e9]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d70aaefe-87b7-46cd-b4ef-19d2eb900420 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:30 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d70aaefe-87b7-46cd-b4ef-19d2eb900420 Sep 23 12:53:30 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:30 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD Sep 23 12:53:30 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:30 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d70aaefe-87b7-46cd-b4ef-19d2eb900420" returned: 0 in 0.256s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:30 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7ff2dc8e-7654-4fba-b364-5d2d3840bcb1 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.898s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da3c3ca-c114-47c7-b116-dc0e8c48825e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d70aaefe-87b7-46cd-b4ef-19d2eb900420', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e68f13c-f563-4e3f-adde-e0432606b248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:30 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-7ff2dc8e-7654-4fba-b364-5d2d3840bcb1 tempest-CreateVolumesFromSnapshotTest-92252839 None] Creating offline snapshot 9f58d8f7-9e15-40ee-aaa5-42601b6387bf of volume 667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:53:30 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Volume volume-d70aaefe-87b7-46cd-b4ef-19d2eb900420 (d70aaefe-87b7-46cd-b4ef-19d2eb900420): created successfully Sep 23 12:53:30 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e68f13c-f563-4e3f-adde-e0432606b248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:30 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Flow 'volume_create_manager' (b971f826-74b2-489f-87c7-e7fa02d4758c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:30 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[390d1bfb-2bb1-4a4d-92b6-3743e1ef1ebe]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7ff2dc8e-7654-4fba-b364-5d2d3840bcb1 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:30 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-fd410dda-2461-4b48-9803-36cf83702271 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Created volume successfully. Sep 23 12:53:30 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b Sep 23 12:53:30 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:30 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD Sep 23 12:53:30 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:30 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7ff2dc8e-7654-4fba-b364-5d2d3840bcb1 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b" returned: 0 in 0.380s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7ff2dc8e-7654-4fba-b364-5d2d3840bcb1 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:30 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD" returned: 1 in 0.395s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:53:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:30 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf 1G Sep 23 12:53:30 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:31 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:31 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7ff2dc8e-7654-4fba-b364-5d2d3840bcb1 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf 1G" returned: 0 in 0.479s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7ff2dc8e-7654-4fba-b364-5d2d3840bcb1 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:31 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf Sep 23 12:53:31 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Flow 'volume_create_manager' (f3db4d67-13c6-4a2e-82b4-94235ac2f485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d2cbe9-8f0f-4f61-8f85-ed51a6758453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d2cbe9-8f0f-4f61-8f85-ed51a6758453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-208667102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48141d5b-0a5e-41fd-b022-c66578033080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0fd194083434f41b11cdd75e2a50bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a560d411-c33b-4807-8674-c9ff074eb1ab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:31Z,use_quota=True,user_id='df31cf4f10ef40f4934a0de2de03ace5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626b0072-3b45-4cdc-96e3-0d08ab7d4a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626b0072-3b45-4cdc-96e3-0d08ab7d4a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb96c4bf-b1e8-4e1b-b9e2-0e8c90bcecfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb96c4bf-b1e8-4e1b-b9e2-0e8c90bcecfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '48141d5b-0a5e-41fd-b022-c66578033080', 'volume_name': 'volume-48141d5b-0a5e-41fd-b022-c66578033080', 'volume_size': 1, 'snapshot_id': 'a560d411-c33b-4807-8674-c9ff074eb1ab'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b826c8-35bc-4e94-ad19-01f4ca7919e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b826c8-35bc-4e94-ad19-01f4ca7919e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:31 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507b8796-814b-4bf1-af42-3bc6977be686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:31 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Volume 48141d5b-0a5e-41fd-b022-c66578033080: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-48141d5b-0a5e-41fd-b022-c66578033080', 'volume_size': 1, 'snapshot_id': 'a560d411-c33b-4807-8674-c9ff074eb1ab'} Sep 23 12:53:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:31 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7ff2dc8e-7654-4fba-b364-5d2d3840bcb1 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf" returned: 0 in 0.312s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:31 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-7ff2dc8e-7654-4fba-b364-5d2d3840bcb1 tempest-CreateVolumesFromSnapshotTest-92252839 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf is being set with open permissions: ugo+rw Sep 23 12:53:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7ff2dc8e-7654-4fba-b364-5d2d3840bcb1 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:31 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf Sep 23 12:53:31 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:31 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7ff2dc8e-7654-4fba-b364-5d2d3840bcb1 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf" returned: 0 in 0.288s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7ff2dc8e-7654-4fba-b364-5d2d3840bcb1 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:31 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.info Sep 23 12:53:31 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:32 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7ff2dc8e-7654-4fba-b364-5d2d3840bcb1 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.info" returned: 0 in 0.278s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:32 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-7ff2dc8e-7654-4fba-b364-5d2d3840bcb1 tempest-CreateVolumesFromSnapshotTest-92252839 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.info is being set with open permissions: ugo+rw Sep 23 12:53:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7ff2dc8e-7654-4fba-b364-5d2d3840bcb1 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:32 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.info Sep 23 12:53:32 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:32 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7ff2dc8e-7654-4fba-b364-5d2d3840bcb1 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.info" returned: 0 in 0.240s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7ff2dc8e-7654-4fba-b364-5d2d3840bcb1 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.869s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1097012203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e7763b-cb8f-49fc-9423-12c3d028e09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200a2157bd6249e49c1e62744fcfb381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:28Z,use_quota=True,user_id='5afcb0c87273431691019cf8af6e2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Creating volume 35e7763b-cb8f-49fc-9423-12c3d028e09b {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:32 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35e7763b-cb8f-49fc-9423-12c3d028e09b 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:32 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35e7763b-cb8f-49fc-9423-12c3d028e09b 1073741824 Sep 23 12:53:32 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:32 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-7ff2dc8e-7654-4fba-b364-5d2d3840bcb1 tempest-CreateVolumesFromSnapshotTest-92252839 None] Create snapshot completed successfully Sep 23 12:53:32 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35e7763b-cb8f-49fc-9423-12c3d028e09b 1073741824" returned: 0 in 0.450s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35e7763b-cb8f-49fc-9423-12c3d028e09b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:32 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35e7763b-cb8f-49fc-9423-12c3d028e09b Sep 23 12:53:32 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:33 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35e7763b-cb8f-49fc-9423-12c3d028e09b" returned: 0 in 0.237s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.451s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-449862176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa3e1ed-26ba-4a10-91e1-1314a5f48e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200a2157bd6249e49c1e62744fcfb381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:28Z,use_quota=True,user_id='5afcb0c87273431691019cf8af6e2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Creating volume 4aa3e1ed-26ba-4a10-91e1-1314a5f48e44 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:33 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44587c3-0b0a-4043-8600-aee1a9b208c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35e7763b-cb8f-49fc-9423-12c3d028e09b', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b33907d7-18b3-4fad-a1ec-2e2481c693c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:33 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44 1073741824 Sep 23 12:53:33 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:33 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Volume volume-35e7763b-cb8f-49fc-9423-12c3d028e09b (35e7763b-cb8f-49fc-9423-12c3d028e09b): created successfully Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b33907d7-18b3-4fad-a1ec-2e2481c693c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Flow 'volume_create_manager' (8d2be40f-165d-4dfe-ad6d-22753ff97534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:33 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-6e9f554c-3812-47f7-833f-aa216fb4b3b9 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Created volume successfully. Sep 23 12:53:33 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44 1073741824" returned: 0 in 0.579s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:33 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44 Sep 23 12:53:33 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Flow 'volume_create_manager' (265fa037-0ba3-46c2-abec-c092ff8be11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4152bb0e-47ca-480a-98e2-236387b00f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4152bb0e-47ca-480a-98e2-236387b00f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-137868125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46cc4067-1385-441c-8002-db79cad1986a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33439cad76484462b1fd56295a62e643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:34Z,use_quota=True,user_id='31f45d14ebe54d9f9ed8612d05b258c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070973b3-e306-4436-81ae-08aaf0f88448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070973b3-e306-4436-81ae-08aaf0f88448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9236b61-28f1-4b1e-a142-ef4aa4aac52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9236b61-28f1-4b1e-a142-ef4aa4aac52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46cc4067-1385-441c-8002-db79cad1986a', 'volume_name': 'volume-46cc4067-1385-441c-8002-db79cad1986a', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b317ed0-1100-4c18-afae-ee8e24317ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b317ed0-1100-4c18-afae-ee8e24317ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d30bbee-6604-4560-a00a-dc0c21fec5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:33 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Volume 46cc4067-1385-441c-8002-db79cad1986a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46cc4067-1385-441c-8002-db79cad1986a', 'volume_size': 1} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:33 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44" returned: 0 in 0.277s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-828410461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5598352a-748e-40c5-b4e2-34bf6507f4d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200a2157bd6249e49c1e62744fcfb381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:29Z,use_quota=True,user_id='5afcb0c87273431691019cf8af6e2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Creating volume 5598352a-748e-40c5-b4e2-34bf6507f4d5 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:34 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5598352a-748e-40c5-b4e2-34bf6507f4d5 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db3f2d2-2f70-453c-ace4-9b0fc4e9270e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:34 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5598352a-748e-40c5-b4e2-34bf6507f4d5 1073741824 Sep 23 12:53:34 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00b2a2d-84d6-4941-a2c7-109d8779eca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:34 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Volume volume-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44 (4aa3e1ed-26ba-4a10-91e1-1314a5f48e44): created successfully Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00b2a2d-84d6-4941-a2c7-109d8779eca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Flow 'volume_create_manager' (959d3d5d-e533-4955-be8a-a238f3652faa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:34 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-74367477-1687-4588-94cf-c1a244d44cc7 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Created volume successfully. Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Flow 'volume_create_manager' (69e9a265-7ae6-462f-8ae6-fb045d57dae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b24a4b-7bce-4a32-86f0-73f253a04f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b24a4b-7bce-4a32-86f0-73f253a04f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1782396236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e0384c-588f-4a18-9b85-24faa5e7e421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33439cad76484462b1fd56295a62e643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:34Z,use_quota=True,user_id='31f45d14ebe54d9f9ed8612d05b258c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab745b3-79fe-425e-8fa3-970575eb6214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab745b3-79fe-425e-8fa3-970575eb6214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c42b43-25cf-46ec-9310-7ab6246580a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c42b43-25cf-46ec-9310-7ab6246580a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e0384c-588f-4a18-9b85-24faa5e7e421', 'volume_name': 'volume-99e0384c-588f-4a18-9b85-24faa5e7e421', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678af3f5-4932-4569-a08a-bc8c36764e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678af3f5-4932-4569-a08a-bc8c36764e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd79f67-53b3-4fb5-856a-a35b029c3471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:34 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Volume 99e0384c-588f-4a18-9b85-24faa5e7e421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e0384c-588f-4a18-9b85-24faa5e7e421', 'volume_size': 1} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:34 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5598352a-748e-40c5-b4e2-34bf6507f4d5 1073741824" returned: 0 in 0.554s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5598352a-748e-40c5-b4e2-34bf6507f4d5 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:34 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5598352a-748e-40c5-b4e2-34bf6507f4d5 Sep 23 12:53:34 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Flow 'volume_create_manager' (c666f673-1c8c-4d8b-be23-e679e48092e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222afb79-552d-4961-a44a-08adb907ee2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222afb79-552d-4961-a44a-08adb907ee2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-775990661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6052bc-95f3-4702-a15c-66429d64b2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33439cad76484462b1fd56295a62e643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:35Z,use_quota=True,user_id='31f45d14ebe54d9f9ed8612d05b258c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ce7b6a-63e4-4472-8a4a-198d9cd883da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ce7b6a-63e4-4472-8a4a-198d9cd883da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b49c832-1202-4c02-8fad-5f0cf212f296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b49c832-1202-4c02-8fad-5f0cf212f296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f6052bc-95f3-4702-a15c-66429d64b2fa', 'volume_name': 'volume-5f6052bc-95f3-4702-a15c-66429d64b2fa', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e85faa-80cb-442b-ba4e-fb6d1ac3add6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e85faa-80cb-442b-ba4e-fb6d1ac3add6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7edf15-42c5-4b29-93b2-1c45da83f09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:34 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Volume 5f6052bc-95f3-4702-a15c-66429d64b2fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f6052bc-95f3-4702-a15c-66429d64b2fa', 'volume_size': 1} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:34 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5598352a-748e-40c5-b4e2-34bf6507f4d5" returned: 0 in 0.302s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.432s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-415380350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200a2157bd6249e49c1e62744fcfb381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:29Z,use_quota=True,user_id='5afcb0c87273431691019cf8af6e2f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Creating volume 6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:34 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec74e69a-617e-4631-b362-8614c2d5d186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5598352a-748e-40c5-b4e2-34bf6507f4d5', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:34 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096 1073741824 Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d89c1b-e79a-46b6-88f6-fce334639388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:34 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:34 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Volume volume-5598352a-748e-40c5-b4e2-34bf6507f4d5 (5598352a-748e-40c5-b4e2-34bf6507f4d5): created successfully Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d89c1b-e79a-46b6-88f6-fce334639388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Flow 'volume_create_manager' (d951eaac-0773-44ed-9bfe-b79d0e6e5b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:35 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-c6024342-d868-4cd4-84a8-19557617b3b6 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Created volume successfully. Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Flow 'volume_create_manager' (b42464cd-f25f-434a-aadb-a2197d25145f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fcfafc3-7b58-473c-b107-f2a669da99e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fcfafc3-7b58-473c-b107-f2a669da99e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-920826852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd6ccec-4626-4dbf-a905-90e768d97852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33439cad76484462b1fd56295a62e643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:35Z,use_quota=True,user_id='31f45d14ebe54d9f9ed8612d05b258c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d759ca9d-94be-4819-8590-2b4cd737f465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d759ca9d-94be-4819-8590-2b4cd737f465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98904de-e92f-46a0-9bf1-17f7b883dea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98904de-e92f-46a0-9bf1-17f7b883dea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcd6ccec-4626-4dbf-a905-90e768d97852', 'volume_name': 'volume-fcd6ccec-4626-4dbf-a905-90e768d97852', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9aef2e3-f6ad-49a0-a2dc-37491a4a350c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9aef2e3-f6ad-49a0-a2dc-37491a4a350c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b824ffba-5dba-4e8f-a0ae-e5ec09dfb28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:35 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Volume fcd6ccec-4626-4dbf-a905-90e768d97852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcd6ccec-4626-4dbf-a905-90e768d97852', 'volume_size': 1} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:35 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096 1073741824" returned: 0 in 0.515s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:35 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096 Sep 23 12:53:35 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Flow 'volume_create_manager' (813c2168-c1be-4284-9c5a-6dcb6bb9c1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35c3142-0c91-4b44-8556-f7bd9ed45040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35c3142-0c91-4b44-8556-f7bd9ed45040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-856949389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33439cad76484462b1fd56295a62e643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:35Z,use_quota=True,user_id='31f45d14ebe54d9f9ed8612d05b258c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01667f6-1499-46eb-8df5-24b5d1c0dd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01667f6-1499-46eb-8df5-24b5d1c0dd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a2c345-6c49-4717-a1c5-3c514c036ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a2c345-6c49-4717-a1c5-3c514c036ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f', 'volume_name': 'volume-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58b34c7-7e22-4c07-8457-52de7240f9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58b34c7-7e22-4c07-8457-52de7240f9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ebb76a-9321-4d9d-87ff-56daed6a0426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:35 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Volume b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f', 'volume_size': 1} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:35 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096" returned: 0 in 0.260s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d117103-0b1a-4ce6-8c2a-ba833de8cce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3989466435584cc5be3e08e8e1f64060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:28Z,use_quota=True,user_id='6c9ce68a1d684279ae9760404ee502da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a8eeb1c-eff2-4232-969b-5a504f79480c),volume_type_id=2a8eeb1c-eff2-4232-969b-5a504f79480c)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Creating volume 1d117103-0b1a-4ce6-8c2a-ba833de8cce6 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:35 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:35 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6 1073741824 Sep 23 12:53:35 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6af03a-a5fa-4ac5-b921-51700368e284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a64016-d211-4b7a-8009-5d6dc3b0336c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:35 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Volume volume-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096 (6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096): created successfully Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a64016-d211-4b7a-8009-5d6dc3b0336c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Flow 'volume_create_manager' (91baec22-b68b-48c6-b34d-47c04212db5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:35 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-27154561-ee14-4b1b-aa52-780d595ca670 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Created volume successfully. Sep 23 12:53:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "cinder-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "cinder-quobyte-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-quobyte-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096" acquired by "delete_volume" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce0386e-1ecd-4702-bc4d-1ecbe5c4d15e]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:36 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096 Sep 23 12:53:36 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:36 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6 1073741824" returned: 0 in 0.499s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:36 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6 Sep 23 12:53:36 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:36 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096" returned: 0 in 0.413s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:36 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096 Sep 23 12:53:36 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:36 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6" returned: 0 in 0.295s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.279s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Acquiring lock "cinder-quobyte-a560d411-c33b-4807-8674-c9ff074eb1ab-48141d5b-0a5e-41fd-b022-c66578033080" by "_create_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Lock "cinder-quobyte-a560d411-c33b-4807-8674-c9ff074eb1ab-48141d5b-0a5e-41fd-b022-c66578033080" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Creating volume 48141d5b-0a5e-41fd-b022-c66578033080 from snapshot a560d411-c33b-4807-8674-c9ff074eb1ab {{(pid=86085) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Acquiring lock "cinder-quobyte-48141d5b-0a5e-41fd-b022-c66578033080" by "_copy_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Attempting download of 529504eb-0715-404f-8134-e483d6329cc0 ((None, [{'url': 'file:///opt/stack/data/glance/images/529504eb-0715-404f-8134-e483d6329cc0', 'metadata': {}}])) to volume 1d117103-0b1a-4ce6-8c2a-ba833de8cce6. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Lock "cinder-quobyte-48141d5b-0a5e-41fd-b022-c66578033080" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] snapshot: a560d411-c33b-4807-8674-c9ff074eb1ab, volume: 48141d5b-0a5e-41fd-b022-c66578033080, {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7ae913-529a-4b31-a960-86a2bf4e7260]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3eda7b4-f704-436d-a14d-32fbf396bbbb]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_529504eb-0715-404f-8134-e483d6329cc0_pbaxxmml {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:36 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096" returned: 0 in 0.271s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-quobyte-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096" released by "delete_volume" :: held 0.732s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:36 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab Sep 23 12:53:36 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:36 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_529504eb-0715-404f-8134-e483d6329cc0_pbaxxmml Sep 23 12:53:36 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Created reservations ['cacefea7-d230-4967-b5e8-dd2c22cdd9d1', '6f98526d-46a0-4db3-902b-157602379842', '63f632ed-8961-497b-a9a1-32572216e925', '8a7d49db-ac5a-4a9c-8459-2031e0d79400'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:36 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:53:36 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:37 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_529504eb-0715-404f-8134-e483d6329cc0_pbaxxmml" returned: 0 in 0.359s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_529504eb-0715-404f-8134-e483d6329cc0_pbaxxmml {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:37 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab" returned: 0 in 0.399s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd31f512-9e0c-453d-bb90-8f450a5e4cf2]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "cinder-5598352a-748e-40c5-b4e2-34bf6507f4d5-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:37 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.279s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:53:37 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Deleted volume successfully. Sep 23 12:53:37 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_529504eb-0715-404f-8134-e483d6329cc0_pbaxxmml Sep 23 12:53:37 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-5598352a-748e-40c5-b4e2-34bf6507f4d5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:37 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 Sep 23 12:53:37 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-dafe3ac7-2723-4368-a147-2bb040b6c4f2 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-6a2a005d-6dba-4d5b-8d86-5fb7fcbd3096-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "cinder-quobyte-5598352a-748e-40c5-b4e2-34bf6507f4d5" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-quobyte-5598352a-748e-40c5-b4e2-34bf6507f4d5" acquired by "delete_volume" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafccf73-7f8a-42bd-9abb-53ca935d3869]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5598352a-748e-40c5-b4e2-34bf6507f4d5 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:37 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5598352a-748e-40c5-b4e2-34bf6507f4d5 Sep 23 12:53:37 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:37 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_529504eb-0715-404f-8134-e483d6329cc0_pbaxxmml" returned: 1 in 0.453s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_529504eb-0715-404f-8134-e483d6329cc0_pbaxxmml' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f1a21c-b252-41a6-ade4-20122944c0b7]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:37 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487" returned: 0 in 0.504s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] will copy from snapshot at /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Creating direct copy from snapshot {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG cinder.utils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Path /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48141d5b-0a5e-41fd-b022-c66578033080 not found in is_blk_device check {{(pid=86085) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48141d5b-0a5e-41fd-b022-c66578033080 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:37 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48141d5b-0a5e-41fd-b022-c66578033080 Sep 23 12:53:37 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:37 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD Sep 23 12:53:37 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:37 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5598352a-748e-40c5-b4e2-34bf6507f4d5" returned: 0 in 0.450s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5598352a-748e-40c5-b4e2-34bf6507f4d5 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:37 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5598352a-748e-40c5-b4e2-34bf6507f4d5 Sep 23 12:53:37 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:37 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:38 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5598352a-748e-40c5-b4e2-34bf6507f4d5" returned: 0 in 0.263s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:38 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD Sep 23 12:53:38 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:38 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-quobyte-5598352a-748e-40c5-b4e2-34bf6507f4d5" released by "delete_volume" :: held 0.760s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:38 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Created reservations ['48d18e3c-4b5a-4628-b122-4e7c0ce5088a', '724c2a2b-ca3e-40da-babc-2039869f3822', 'c1d66c95-3f89-49f7-81f4-01305562b15d', '691a3b73-ff4f-42b5-9eb7-c318c67f0130'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:53:38 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD" returned: 1 in 0.473s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:53:38 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] 529504eb-0715-404f-8134-e483d6329cc0 was raw, converting to qcow2 {{(pid=86085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 12:53:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:38 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6 Sep 23 12:53:38 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:38 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "cinder-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:38 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:53:38 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:38 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:38 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "cinder-quobyte-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:38 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-quobyte-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44" acquired by "delete_volume" :: waited 0.053s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:38 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b75409-9494-4e84-bc77-8df0a8efb2bb]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:39 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44 Sep 23 12:53:39 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:39 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.902s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:39 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:53:39 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Deleted volume successfully. Sep 23 12:53:39 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-71ed36f3-d3b0-4841-94ff-2faaeba533d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-5598352a-748e-40c5-b4e2-34bf6507f4d5-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:39 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6" returned: 0 in 1.258s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:39 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_529504eb-0715-404f-8134-e483d6329cc0_05v9fv50devstack@QuobyteHD, size 0.00 MB, duration 1.26 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6 {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:53:39 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 12:53:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:39 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6 1G Sep 23 12:53:39 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:40 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44" returned: 0 in 1.074s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:40 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44 Sep 23 12:53:40 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:40 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44" returned: 0 in 0.329s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-quobyte-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44" released by "delete_volume" :: held 1.508s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:40 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6 1G" returned: 0 in 0.737s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Downloaded image 529504eb-0715-404f-8134-e483d6329cc0 ((None, [{'url': 'file:///opt/stack/data/glance/images/529504eb-0715-404f-8134-e483d6329cc0', 'metadata': {}}])) to volume 1d117103-0b1a-4ce6-8c2a-ba833de8cce6 successfully. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Temporary image 529504eb-0715-404f-8134-e483d6329cc0 for user 6c9ce68a1d684279ae9760404ee502da is deleted. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Marking volume 1d117103-0b1a-4ce6-8c2a-ba833de8cce6 as bootable. {{(pid=86085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Copying metadata from image 529504eb-0715-404f-8134-e483d6329cc0 to 1d117103-0b1a-4ce6-8c2a-ba833de8cce6. {{(pid=86085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Creating volume glance metadata for volume 1d117103-0b1a-4ce6-8c2a-ba833de8cce6 backed by image 529504eb-0715-404f-8134-e483d6329cc0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '529504eb-0715-404f-8134-e483d6329cc0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '54da53d82c91d1fe83f394fd554dd048', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Created reservations ['ce84a263-1abb-45af-91cf-72761e033aa5', '9fc2755f-11a4-4245-bea9-d629b2efd56a', '3c8f44af-d60b-4c49-bcaa-80af8ff217a6', '8b5055be-bbd1-4e23-ad19-9c2f5a65c904'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa82b240-05a4-4e87-86ca-657323588d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6', 'volume_size': 1, 'image_id': '529504eb-0715-404f-8134-e483d6329cc0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/529504eb-0715-404f-8134-e483d6329cc0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '54da53d82c91d1fe83f394fd554dd048', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3989466435584cc5be3e08e8e1f64060', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '204aa822e6fdf30ab404e41f0351bc68bd822c2de84fe5fcb9213da4a335795a08aabf3164a4e4356e6efdf582553a7ddd805b982be4621057a1a6b77d5c3d20', 'id': '529504eb-0715-404f-8134-e483d6329cc0', 'created_at': datetime.datetime(2026, 9, 23, 10, 53, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 53, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/529504eb-0715-404f-8134-e483d6329cc0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c6a20f-db17-404a-90cf-6a6601100406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:40 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Volume volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6 (1d117103-0b1a-4ce6-8c2a-ba833de8cce6): created successfully Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c6a20f-db17-404a-90cf-6a6601100406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Flow 'volume_create_manager' (6caab932-3910-4e7d-8e43-2537df51a132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:40 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-a02fcc64-9540-433f-b76b-13103a9a4f06 tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Created volume successfully. Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:40 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:53:40 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "cinder-35e7763b-cb8f-49fc-9423-12c3d028e09b-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-35e7763b-cb8f-49fc-9423-12c3d028e09b-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:41 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.615s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:53:41 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Deleted volume successfully. Sep 23 12:53:41 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:53:41 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-972418ee-5aaf-44cf-b5fb-ea6ccb9412d3 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-4aa3e1ed-26ba-4a10-91e1-1314a5f48e44-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "cinder-quobyte-35e7763b-cb8f-49fc-9423-12c3d028e09b" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-quobyte-35e7763b-cb8f-49fc-9423-12c3d028e09b" acquired by "delete_volume" :: waited 0.036s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[47806a10-ad2e-481c-b0c1-20dcaca36785]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35e7763b-cb8f-49fc-9423-12c3d028e09b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:41 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.513s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:53:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:53:41 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35e7763b-cb8f-49fc-9423-12c3d028e09b Sep 23 12:53:41 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Acquiring lock "cinder-1d117103-0b1a-4ce6-8c2a-ba833de8cce6-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Lock "cinder-1d117103-0b1a-4ce6-8c2a-ba833de8cce6-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Acquiring lock "cinder-quobyte-1d117103-0b1a-4ce6-8c2a-ba833de8cce6" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Lock "cinder-quobyte-1d117103-0b1a-4ce6-8c2a-ba833de8cce6" acquired by "delete_volume" :: waited 0.042s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:42 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[91781f41-2a9d-48cf-8bdb-97efadba3313]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:42 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6 Sep 23 12:53:42 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:42 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35e7763b-cb8f-49fc-9423-12c3d028e09b" returned: 0 in 0.969s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35e7763b-cb8f-49fc-9423-12c3d028e09b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:42 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35e7763b-cb8f-49fc-9423-12c3d028e09b Sep 23 12:53:42 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:43 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-35e7763b-cb8f-49fc-9423-12c3d028e09b" returned: 0 in 0.447s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-quobyte-35e7763b-cb8f-49fc-9423-12c3d028e09b" released by "delete_volume" :: held 1.523s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:43 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6" returned: 0 in 0.762s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:43 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6 Sep 23 12:53:43 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Created reservations ['e036c6ec-9a9e-4274-9d0f-560e62ad61ab', 'bcf2c35c-e35c-4a1e-b15a-907b4367521b', '1010d309-e13d-4688-8802-d7c7ae2cb6b0', '90dee587-0486-40c2-b239-de85af2c79b1'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:43 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:53:43 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:43 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1d117103-0b1a-4ce6-8c2a-ba833de8cce6" returned: 0 in 0.559s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Lock "cinder-quobyte-1d117103-0b1a-4ce6-8c2a-ba833de8cce6" released by "delete_volume" :: held 1.420s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "cinder-d70aaefe-87b7-46cd-b4ef-19d2eb900420-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-d70aaefe-87b7-46cd-b4ef-19d2eb900420-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:43 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "cinder-quobyte-d70aaefe-87b7-46cd-b4ef-19d2eb900420" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.589s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:53:43 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Deleted volume successfully. Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-quobyte-d70aaefe-87b7-46cd-b4ef-19d2eb900420" acquired by "delete_volume" :: waited 0.031s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:43 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Created reservations ['9bafde1d-e721-481d-89fb-1ad09dfc7098', '8e2f2720-9892-4141-be06-9b9d07fcba4d', '947afd74-c663-48af-8673-2fa309e514fe', '40fe5478-8aeb-4620-9292-9be4117668ce'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:53:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1b193f53-d2b8-4bdd-b513-fb02dfd13313 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-35e7763b-cb8f-49fc-9423-12c3d028e09b-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:44 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8277ebd5-3c8e-431a-b80a-3561a03de579]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d70aaefe-87b7-46cd-b4ef-19d2eb900420 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:44 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:44 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:44 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d70aaefe-87b7-46cd-b4ef-19d2eb900420 Sep 23 12:53:44 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:44 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:53:44 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:44 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.543s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:44 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:53:44 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Deleted volume successfully. Sep 23 12:53:44 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d70aaefe-87b7-46cd-b4ef-19d2eb900420" returned: 0 in 0.714s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d70aaefe-87b7-46cd-b4ef-19d2eb900420 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:44 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d70aaefe-87b7-46cd-b4ef-19d2eb900420 Sep 23 12:53:44 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-aaf53443-3ae7-4e5f-a064-161267e84abb tempest-VolumeAndVolumeTypeFromImageTest-715051160 None] Lock "cinder-1d117103-0b1a-4ce6-8c2a-ba833de8cce6-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:45 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-d70aaefe-87b7-46cd-b4ef-19d2eb900420" returned: 0 in 0.405s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-quobyte-d70aaefe-87b7-46cd-b4ef-19d2eb900420" released by "delete_volume" :: held 1.227s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:45 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Created reservations ['b586dd94-2317-4675-b42f-7e6f71e81009', 'bfb37215-6030-46c7-8000-3b356fb7f2b9', 'f27dac08-4ac1-48e1-85f2-6ba843fd61cc', '0c110548-1a7b-4b28-b44b-d70adaf53fad'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:53:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:45 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:53:45 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:45 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.494s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:45 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:53:45 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Deleted volume successfully. Sep 23 12:53:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-88e6b6d4-1587-4a2b-93ce-a19456c99436 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-d70aaefe-87b7-46cd-b4ef-19d2eb900420-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "cinder-59ddccaa-1502-4608-89bc-d6f4264e6274-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-59ddccaa-1502-4608-89bc-d6f4264e6274-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:46 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48141d5b-0a5e-41fd-b022-c66578033080" returned: 0 in 8.603s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Image conversion details: src /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487, size 1024.00 MB, duration 8.60 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48141d5b-0a5e-41fd-b022-c66578033080 {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:53:46 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Converted 1024.00 MB image at 119.01 MB/s Sep 23 12:53:46 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48141d5b-0a5e-41fd-b022-c66578033080 is being set with open permissions: ugo+rw Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48141d5b-0a5e-41fd-b022-c66578033080 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:46 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48141d5b-0a5e-41fd-b022-c66578033080 Sep 23 12:53:46 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "cinder-quobyte-59ddccaa-1502-4608-89bc-d6f4264e6274" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-quobyte-59ddccaa-1502-4608-89bc-d6f4264e6274" acquired by "delete_volume" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3e68dd-07ec-4279-816d-4808cc1b52b8]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-59ddccaa-1502-4608-89bc-d6f4264e6274 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:46 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-59ddccaa-1502-4608-89bc-d6f4264e6274 Sep 23 12:53:46 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:46 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48141d5b-0a5e-41fd-b022-c66578033080" returned: 0 in 0.277s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Lock "cinder-quobyte-48141d5b-0a5e-41fd-b022-c66578033080" released by "_copy_volume_from_snapshot" :: held 9.901s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Lock "cinder-quobyte-a560d411-c33b-4807-8674-c9ff074eb1ab-48141d5b-0a5e-41fd-b022-c66578033080" released by "_create_volume_from_snapshot" :: held 9.986s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.629s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-137868125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46cc4067-1385-441c-8002-db79cad1986a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33439cad76484462b1fd56295a62e643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:34Z,use_quota=True,user_id='31f45d14ebe54d9f9ed8612d05b258c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Creating volume 46cc4067-1385-441c-8002-db79cad1986a {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:46 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-46cc4067-1385-441c-8002-db79cad1986a 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:46 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-46cc4067-1385-441c-8002-db79cad1986a 1073741824 Sep 23 12:53:46 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507b8796-814b-4bf1-af42-3bc6977be686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48141d5b-0a5e-41fd-b022-c66578033080', 'volume_size': 1, 'snapshot_id': 'a560d411-c33b-4807-8674-c9ff074eb1ab'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6894690-01ad-44de-933d-b9f38cab7b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:46 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Volume volume-48141d5b-0a5e-41fd-b022-c66578033080 (48141d5b-0a5e-41fd-b022-c66578033080): created successfully Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6894690-01ad-44de-933d-b9f38cab7b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Flow 'volume_create_manager' (f3db4d67-13c6-4a2e-82b4-94235ac2f485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:46 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-59ac9d92-2068-4a3d-98c6-55bb814cbb9d tempest-VolumeDependencyTests-619904691 None] Created volume successfully. Sep 23 12:53:46 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-59ddccaa-1502-4608-89bc-d6f4264e6274" returned: 0 in 0.460s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-59ddccaa-1502-4608-89bc-d6f4264e6274 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:46 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-59ddccaa-1502-4608-89bc-d6f4264e6274 Sep 23 12:53:46 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] Acquiring lock "cinder-a560d411-c33b-4807-8674-c9ff074eb1ab-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] Lock "cinder-a560d411-c33b-4807-8674-c9ff074eb1ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] Acquiring lock "cinder-quobyte-2f1ba096-2b41-4739-8dfd-44b2a8b01487" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] Lock "cinder-quobyte-2f1ba096-2b41-4739-8dfd-44b2a8b01487" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] Acquiring lock "cinder-quobyte-a560d411-c33b-4807-8674-c9ff074eb1ab" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] Lock "cinder-quobyte-a560d411-c33b-4807-8674-c9ff074eb1ab" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] Deleting offline snapshot a560d411-c33b-4807-8674-c9ff074eb1ab of volume 2f1ba096-2b41-4739-8dfd-44b2a8b01487 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] snapshot_file for this snap is: volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:53:47 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ea35d8-caf4-405d-a552-546bccae106e]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-59ddccaa-1502-4608-89bc-d6f4264e6274" returned: 0 in 0.348s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-quobyte-59ddccaa-1502-4608-89bc-d6f4264e6274" released by "delete_volume" :: held 0.872s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Created reservations ['b07d360f-bae1-4c48-a8f7-bd6bb2123966', '5237fc1b-40dc-439f-baac-dbb19946ab98', 'f03f5a5b-a284-4570-833f-f751fd5210f9', '5e113acb-bfbb-4d48-88d4-479b5d7cb6e0'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:53:47 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab Sep 23 12:53:47 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:47 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-46cc4067-1385-441c-8002-db79cad1986a 1073741824" returned: 0 in 0.721s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-46cc4067-1385-441c-8002-db79cad1986a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:47 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-46cc4067-1385-441c-8002-db79cad1986a Sep 23 12:53:47 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:47 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:53:47 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:47 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab" returned: 0 in 0.528s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e782771d-9de7-40ee-b424-d04d7fa823f6]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:47 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:47 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-46cc4067-1385-441c-8002-db79cad1986a" returned: 0 in 0.340s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.305s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.366s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1782396236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e0384c-588f-4a18-9b85-24faa5e7e421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33439cad76484462b1fd56295a62e643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:34Z,use_quota=True,user_id='31f45d14ebe54d9f9ed8612d05b258c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Creating volume 99e0384c-588f-4a18-9b85-24faa5e7e421 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:47 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99e0384c-588f-4a18-9b85-24faa5e7e421 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:47 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Deleted volume successfully. Sep 23 12:53:47 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99e0384c-588f-4a18-9b85-24faa5e7e421 1073741824 Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d30bbee-6604-4560-a00a-dc0c21fec5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46cc4067-1385-441c-8002-db79cad1986a', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:47 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65bd4f96-2719-4242-98d3-7db9c795af46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-f9f1f779-6291-4666-aa3f-5427c5f3dd84 tempest-CreateVolumesFromSourceVolumeTest-394468214 None] Lock "cinder-59ddccaa-1502-4608-89bc-d6f4264e6274-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:47 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Volume volume-46cc4067-1385-441c-8002-db79cad1986a (46cc4067-1385-441c-8002-db79cad1986a): created successfully Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65bd4f96-2719-4242-98d3-7db9c795af46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Flow 'volume_create_manager' (265fa037-0ba3-46c2-abec-c092ff8be11d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:47 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 Sep 23 12:53:47 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:47 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0eb85646-6b5c-4efe-8a36-df808d742a29 tempest-CreateVolumesFromSnapshotTest-92252839 None] Created volume successfully. Sep 23 12:53:48 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99e0384c-588f-4a18-9b85-24faa5e7e421 1073741824" returned: 0 in 0.544s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99e0384c-588f-4a18-9b85-24faa5e7e421 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:48 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487" returned: 0 in 0.642s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:48 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99e0384c-588f-4a18-9b85-24faa5e7e421 Sep 23 12:53:48 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:48 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab Sep 23 12:53:48 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:48 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99e0384c-588f-4a18-9b85-24faa5e7e421" returned: 0 in 0.301s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.875s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-775990661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6052bc-95f3-4702-a15c-66429d64b2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33439cad76484462b1fd56295a62e643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:35Z,use_quota=True,user_id='31f45d14ebe54d9f9ed8612d05b258c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Creating volume 5f6052bc-95f3-4702-a15c-66429d64b2fa {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:48 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f6052bc-95f3-4702-a15c-66429d64b2fa 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd79f67-53b3-4fb5-856a-a35b029c3471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e0384c-588f-4a18-9b85-24faa5e7e421', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:48 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f6052bc-95f3-4702-a15c-66429d64b2fa 1073741824 Sep 23 12:53:48 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a958321-f60d-4d31-ae38-fb058b6687d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:48 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Volume volume-99e0384c-588f-4a18-9b85-24faa5e7e421 (99e0384c-588f-4a18-9b85-24faa5e7e421): created successfully Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a958321-f60d-4d31-ae38-fb058b6687d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Flow 'volume_create_manager' (69e9a265-7ae6-462f-8ae6-fb045d57dae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:48 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0b3b0b29-a0e3-4dbc-9496-67c256b53305 tempest-CreateVolumesFromSnapshotTest-92252839 None] Created volume successfully. Sep 23 12:53:48 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab" returned: 0 in 0.478s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:48 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab Sep 23 12:53:48 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:49 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487.a560d411-c33b-4807-8674-c9ff074eb1ab" returned: 0 in 0.400s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] Lock "cinder-quobyte-a560d411-c33b-4807-8674-c9ff074eb1ab" released by "_delete_snapshot" :: held 2.190s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] Lock "cinder-quobyte-2f1ba096-2b41-4739-8dfd-44b2a8b01487" released by "delete_snapshot" :: held 2.218s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:49 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f6052bc-95f3-4702-a15c-66429d64b2fa 1073741824" returned: 0 in 0.652s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f6052bc-95f3-4702-a15c-66429d64b2fa {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:49 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f6052bc-95f3-4702-a15c-66429d64b2fa Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] Created reservations ['8204c961-5d01-4f5d-9d2c-0c94a05ba4a0', '2468a7b2-f2c8-417f-a6d6-5d70b2ee018f', 'a146c6dc-7bd2-4f78-b303-37f083fbb3ea', 'b5119486-c395-4bda-82d8-ed6c40882478'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:53:49 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] Delete snapshot completed successfully. Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e4b85e58-853e-40c0-bb16-4409ab122ef7 tempest-VolumeDependencyTests-619904691 None] Lock "cinder-a560d411-c33b-4807-8674-c9ff074eb1ab-delete_snapshot" released by "delete_snapshot" :: held 2.433s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:49 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:49 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f6052bc-95f3-4702-a15c-66429d64b2fa" returned: 0 in 0.404s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.623s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-920826852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd6ccec-4626-4dbf-a905-90e768d97852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33439cad76484462b1fd56295a62e643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:35Z,use_quota=True,user_id='31f45d14ebe54d9f9ed8612d05b258c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Creating volume fcd6ccec-4626-4dbf-a905-90e768d97852 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:49 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcd6ccec-4626-4dbf-a905-90e768d97852 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:49 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcd6ccec-4626-4dbf-a905-90e768d97852 1073741824 Sep 23 12:53:49 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7edf15-42c5-4b29-93b2-1c45da83f09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f6052bc-95f3-4702-a15c-66429d64b2fa', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8ceb2a-7207-4f8d-811e-7093e1d69982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:49 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Volume volume-5f6052bc-95f3-4702-a15c-66429d64b2fa (5f6052bc-95f3-4702-a15c-66429d64b2fa): created successfully Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8ceb2a-7207-4f8d-811e-7093e1d69982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:49 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Flow 'volume_create_manager' (c666f673-1c8c-4d8b-be23-e679e48092e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:49 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-4993c3ef-b491-4dbd-93c7-9f5ef54c14d7 tempest-CreateVolumesFromSnapshotTest-92252839 None] Created volume successfully. Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] Acquiring lock "cinder-2f1ba096-2b41-4739-8dfd-44b2a8b01487-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] Lock "cinder-2f1ba096-2b41-4739-8dfd-44b2a8b01487-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] Acquiring lock "cinder-quobyte-2f1ba096-2b41-4739-8dfd-44b2a8b01487" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] Lock "cinder-quobyte-2f1ba096-2b41-4739-8dfd-44b2a8b01487" acquired by "delete_volume" :: waited 0.035s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b05a11d-7d20-44b0-8126-7b22370009ee]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:50 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcd6ccec-4626-4dbf-a905-90e768d97852 1073741824" returned: 0 in 0.747s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcd6ccec-4626-4dbf-a905-90e768d97852 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:50 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcd6ccec-4626-4dbf-a905-90e768d97852 Sep 23 12:53:50 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:50 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 Sep 23 12:53:50 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:50 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcd6ccec-4626-4dbf-a905-90e768d97852" returned: 0 in 0.331s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.318s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-856949389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33439cad76484462b1fd56295a62e643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:35Z,use_quota=True,user_id='31f45d14ebe54d9f9ed8612d05b258c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Creating volume b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:50 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b824ffba-5dba-4e8f-a0ae-e5ec09dfb28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcd6ccec-4626-4dbf-a905-90e768d97852', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:50 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f 1073741824 Sep 23 12:53:50 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5002c8e1-94fd-4ad2-9c4b-d8c0acf1d6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:50 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487" returned: 0 in 0.474s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:51 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Volume volume-fcd6ccec-4626-4dbf-a905-90e768d97852 (fcd6ccec-4626-4dbf-a905-90e768d97852): created successfully Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5002c8e1-94fd-4ad2-9c4b-d8c0acf1d6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:51 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487 Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Flow 'volume_create_manager' (b42464cd-f25f-434a-aadb-a2197d25145f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:51 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:51 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-e0d1fe33-1f9b-43b9-97d7-04816241e0e4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Created volume successfully. Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Flow 'volume_create_manager' (ca1ae9da-240e-4e57-a0e4-c314271a9dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f536200-41dc-469d-bda1-b7091a0035c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f536200-41dc-469d-bda1-b7091a0035c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-931210499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a023256f-2180-4a0e-b828-f8625791a1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dcf614296ad4488aa92238a8953453f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:51Z,use_quota=True,user_id='6b4e175331a748c296ddee54abd770de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f4b0484-6d89-46b2-be79-708cd4a7e5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f4b0484-6d89-46b2-be79-708cd4a7e5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71d7446-4dcb-431b-87d4-833d09534a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71d7446-4dcb-431b-87d4-833d09534a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a023256f-2180-4a0e-b828-f8625791a1ef', 'volume_name': 'volume-a023256f-2180-4a0e-b828-f8625791a1ef', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ea18e2-b596-428d-9b70-772d0453e6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:51 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ea18e2-b596-428d-9b70-772d0453e6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b9ba4c-1613-4f37-ab34-322cdf7e6142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:51 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Volume a023256f-2180-4a0e-b828-f8625791a1ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a023256f-2180-4a0e-b828-f8625791a1ef', 'volume_size': 1} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-2f1ba096-2b41-4739-8dfd-44b2a8b01487" returned: 0 in 0.432s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] Lock "cinder-quobyte-2f1ba096-2b41-4739-8dfd-44b2a8b01487" released by "delete_volume" :: held 1.000s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] Created reservations ['24cdfcb3-cf16-4dda-b43a-2821f664a715', 'f523c54c-ceee-4d1a-a8c0-e0f37499b431', 'fb23d1af-749e-47f9-a95d-0b2c0b4d96b6', 'efa241f1-6b98-4672-82dd-8697c5a8edbb'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:53:51 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f 1073741824" returned: 0 in 0.724s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:51 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f Sep 23 12:53:51 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:51 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:53:51 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Flow 'volume_create_manager' (b6f50e86-60ad-4613-b1f5-65fcf17ece96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79b3936-8ae7-4c2d-9225-80095f6b9452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:51 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79b3936-8ae7-4c2d-9225-80095f6b9452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-649529904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e22d2908-2c4e-4222-8e8e-955ebbd5bae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dcf614296ad4488aa92238a8953453f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:52Z,use_quota=True,user_id='6b4e175331a748c296ddee54abd770de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1743c498-6489-412e-ad50-7e918c5f85fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1743c498-6489-412e-ad50-7e918c5f85fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b1ae6d-1328-4e5e-956c-69ef5116f5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b1ae6d-1328-4e5e-956c-69ef5116f5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e22d2908-2c4e-4222-8e8e-955ebbd5bae8', 'volume_name': 'volume-e22d2908-2c4e-4222-8e8e-955ebbd5bae8', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c405cf-f8c3-4d5f-8657-c7f4b26c0b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c405cf-f8c3-4d5f-8657-c7f4b26c0b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe70bde-9c6f-49c2-859a-16446269534c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:52 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Volume e22d2908-2c4e-4222-8e8e-955ebbd5bae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e22d2908-2c4e-4222-8e8e-955ebbd5bae8', 'volume_size': 1} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:52 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.348s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:53:52 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] Deleted volume successfully. Sep 23 12:53:52 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6a79eed8-cfd1-425c-9b82-d232fa24f0dc tempest-VolumeDependencyTests-619904691 None] Lock "cinder-2f1ba096-2b41-4739-8dfd-44b2a8b01487-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f" returned: 0 in 0.444s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.743s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-931210499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a023256f-2180-4a0e-b828-f8625791a1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dcf614296ad4488aa92238a8953453f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:51Z,use_quota=True,user_id='6b4e175331a748c296ddee54abd770de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Creating volume a023256f-2180-4a0e-b828-f8625791a1ef {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:52 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a023256f-2180-4a0e-b828-f8625791a1ef 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ebb76a-9321-4d9d-87ff-56daed6a0426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:52 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a023256f-2180-4a0e-b828-f8625791a1ef 1073741824 Sep 23 12:53:52 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68878bb2-04e6-4193-8cf5-24efea34b706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:52 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Volume volume-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f (b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f): created successfully Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68878bb2-04e6-4193-8cf5-24efea34b706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Flow 'volume_create_manager' (813c2168-c1be-4284-9c5a-6dcb6bb9c1f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:52 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-caf3e2bc-1cd4-402a-8e32-e8bc19fbc7b0 tempest-CreateVolumesFromSnapshotTest-92252839 None] Created volume successfully. Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Flow 'volume_create_manager' (b16320cc-59c4-4228-96fd-9b94c6d95880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00d2bbf-061e-4e29-904b-f88d486d2ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00d2bbf-061e-4e29-904b-f88d486d2ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1958262089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=592568b0-8ed2-43f5-a9f8-6a2efcfccf8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dcf614296ad4488aa92238a8953453f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:52Z,use_quota=True,user_id='6b4e175331a748c296ddee54abd770de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88560d9c-6b1b-47b1-8674-ad41b0b9266e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88560d9c-6b1b-47b1-8674-ad41b0b9266e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01af50da-41fe-4f46-8063-05c76124c805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01af50da-41fe-4f46-8063-05c76124c805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '592568b0-8ed2-43f5-a9f8-6a2efcfccf8c', 'volume_name': 'volume-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37df1e4-64d3-4d53-9a23-c1bd64e64e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37df1e4-64d3-4d53-9a23-c1bd64e64e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c576947-4bb1-43fb-9d71-250de3a4f1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:52 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Volume 592568b0-8ed2-43f5-a9f8-6a2efcfccf8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c', 'volume_size': 1} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] Acquiring lock "cinder-48141d5b-0a5e-41fd-b022-c66578033080-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:52 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a023256f-2180-4a0e-b828-f8625791a1ef 1073741824" returned: 0 in 0.646s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] Lock "cinder-48141d5b-0a5e-41fd-b022-c66578033080-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a023256f-2180-4a0e-b828-f8625791a1ef {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:52 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a023256f-2180-4a0e-b828-f8625791a1ef Sep 23 12:53:52 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "cinder-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] Acquiring lock "cinder-quobyte-48141d5b-0a5e-41fd-b022-c66578033080" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] Lock "cinder-quobyte-48141d5b-0a5e-41fd-b022-c66578033080" acquired by "delete_volume" :: waited 0.055s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f27787-5d0e-4ef8-a524-0b13ae476717]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48141d5b-0a5e-41fd-b022-c66578033080 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "cinder-quobyte-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Flow 'volume_create_manager' (d53d1ec0-6918-49fd-aa04-e29d9d267f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71c5289-0c22-4e8c-9cc8-5e5722bb14be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-quobyte-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f" acquired by "delete_volume" :: waited 0.076s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:53 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48141d5b-0a5e-41fd-b022-c66578033080 Sep 23 12:53:53 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71c5289-0c22-4e8c-9cc8-5e5722bb14be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-452649023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950c426c-7493-4a95-8604-fdd0e137f6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dcf614296ad4488aa92238a8953453f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:53Z,use_quota=True,user_id='6b4e175331a748c296ddee54abd770de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4372d61-98d1-47d6-b004-29930372ff10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4372d61-98d1-47d6-b004-29930372ff10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1909f33d-0038-4674-99e1-f6778519c909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1909f33d-0038-4674-99e1-f6778519c909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '950c426c-7493-4a95-8604-fdd0e137f6a0', 'volume_name': 'volume-950c426c-7493-4a95-8604-fdd0e137f6a0', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0581c18b-5c4e-4880-8a8a-4d6604a1073a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0581c18b-5c4e-4880-8a8a-4d6604a1073a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfeef3e-0b8c-419c-b9df-d58f8a93775a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:53 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Volume 950c426c-7493-4a95-8604-fdd0e137f6a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-950c426c-7493-4a95-8604-fdd0e137f6a0', 'volume_size': 1} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[13efdf7d-81ed-4acf-9c04-88c71c5f13a8]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:53 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a023256f-2180-4a0e-b828-f8625791a1ef" returned: 0 in 0.477s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.351s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-649529904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e22d2908-2c4e-4222-8e8e-955ebbd5bae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dcf614296ad4488aa92238a8953453f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:52Z,use_quota=True,user_id='6b4e175331a748c296ddee54abd770de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Creating volume e22d2908-2c4e-4222-8e8e-955ebbd5bae8 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:53 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e22d2908-2c4e-4222-8e8e-955ebbd5bae8 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:53 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e22d2908-2c4e-4222-8e8e-955ebbd5bae8 1073741824 Sep 23 12:53:53 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b9ba4c-1613-4f37-ab34-322cdf7e6142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a023256f-2180-4a0e-b828-f8625791a1ef', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3abb13e1-f232-4273-b637-7731b6ff6b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:53 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f Sep 23 12:53:53 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Volume volume-a023256f-2180-4a0e-b828-f8625791a1ef (a023256f-2180-4a0e-b828-f8625791a1ef): created successfully Sep 23 12:53:53 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3abb13e1-f232-4273-b637-7731b6ff6b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Flow 'volume_create_manager' (ca1ae9da-240e-4e57-a0e4-c314271a9dac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:53 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-5d0b1a78-2f40-4949-bef3-6690d514f42d tempest-CreateVolumesFromImageTest-711336980 None] Created volume successfully. Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Flow 'volume_create_manager' (7c7fbc9d-57a4-4051-989e-9f13cc7dddd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ea1424-f506-47fe-a7a6-9953f2ae8a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ea1424-f506-47fe-a7a6-9953f2ae8a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-417577023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d56b11-5571-4045-b648-6262a1604636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dcf614296ad4488aa92238a8953453f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:53Z,use_quota=True,user_id='6b4e175331a748c296ddee54abd770de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095610d6-7ce9-40ce-a032-4102ad191300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095610d6-7ce9-40ce-a032-4102ad191300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feda5e22-a834-432b-ab97-50b449c4b7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feda5e22-a834-432b-ab97-50b449c4b7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23d56b11-5571-4045-b648-6262a1604636', 'volume_name': 'volume-23d56b11-5571-4045-b648-6262a1604636', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ab94a8-5581-4b15-b13f-40d500c5198c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ab94a8-5581-4b15-b13f-40d500c5198c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05eb724-3863-42b8-838f-ff4e08b938df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:53 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Volume 23d56b11-5571-4045-b648-6262a1604636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23d56b11-5571-4045-b648-6262a1604636', 'volume_size': 1} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:53 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48141d5b-0a5e-41fd-b022-c66578033080" returned: 0 in 0.661s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48141d5b-0a5e-41fd-b022-c66578033080 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:53 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48141d5b-0a5e-41fd-b022-c66578033080 Sep 23 12:53:53 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:53 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f" returned: 0 in 0.581s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:53 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f Sep 23 12:53:53 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:53:54 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Flow 'volume_create_manager' (34888197-de23-432a-80dd-e5315dfaee02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:54 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dcd8752-1ab1-4156-b510-bcd731e7e264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e22d2908-2c4e-4222-8e8e-955ebbd5bae8 1073741824" returned: 0 in 0.713s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-48141d5b-0a5e-41fd-b022-c66578033080" returned: 0 in 0.380s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dcd8752-1ab1-4156-b510-bcd731e7e264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-35038557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818124f9-c578-406b-9fdf-09a435c3d63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e226d987edf419a959d71bb9c4ddf90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:54Z,use_quota=True,user_id='cae128272f00499fb10c648daf47bdbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917c010f-c64b-4caa-83a5-274ee6a1c4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917c010f-c64b-4caa-83a5-274ee6a1c4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537aa503-c1b1-4cdd-a6cc-f26ea1c7952f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537aa503-c1b1-4cdd-a6cc-f26ea1c7952f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '818124f9-c578-406b-9fdf-09a435c3d63c', 'volume_name': 'volume-818124f9-c578-406b-9fdf-09a435c3d63c', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd71c1e-7c38-489d-80be-668d8c65e283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd71c1e-7c38-489d-80be-668d8c65e283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5caa0283-da56-4883-823c-334dbd1008c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:54 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Volume 818124f9-c578-406b-9fdf-09a435c3d63c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-818124f9-c578-406b-9fdf-09a435c3d63c', 'volume_size': 1} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] Lock "cinder-quobyte-48141d5b-0a5e-41fd-b022-c66578033080" released by "delete_volume" :: held 1.167s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e22d2908-2c4e-4222-8e8e-955ebbd5bae8 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:54 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f" returned: 0 in 0.320s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:54 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e22d2908-2c4e-4222-8e8e-955ebbd5bae8 Sep 23 12:53:54 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-quobyte-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f" released by "delete_volume" :: held 1.012s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] Created reservations ['c63397ab-b8fb-42ab-94af-d5cf058535cb', '825411f3-981d-4619-b225-16810132260f', 'e7073ea5-95c0-40f8-8674-4eaaeb5460d4', '3af0fa92-d199-4bdd-a168-a3a155b12126'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] Created reservations ['0ce1199c-330a-455a-8547-f5a8a26dabf1', '630dbffd-2e89-466c-a6c7-224ccfbbb5bf', '1e46ee2c-5e3f-4faf-b303-24a61b6f80e3', 'f94dee63-0a25-47b7-8ea8-4a5fc23bab04'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:54 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:53:54 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:54 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:53:54 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:54 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e22d2908-2c4e-4222-8e8e-955ebbd5bae8" returned: 0 in 0.305s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.925s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1958262089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=592568b0-8ed2-43f5-a9f8-6a2efcfccf8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dcf614296ad4488aa92238a8953453f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:52Z,use_quota=True,user_id='6b4e175331a748c296ddee54abd770de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Creating volume 592568b0-8ed2-43f5-a9f8-6a2efcfccf8c {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:54 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:54 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c 1073741824 Sep 23 12:53:54 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe70bde-9c6f-49c2-859a-16446269534c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e22d2908-2c4e-4222-8e8e-955ebbd5bae8', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18ada59-2145-4203-894d-e4d366fe355f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:54 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Volume volume-e22d2908-2c4e-4222-8e8e-955ebbd5bae8 (e22d2908-2c4e-4222-8e8e-955ebbd5bae8): created successfully Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18ada59-2145-4203-894d-e4d366fe355f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Flow 'volume_create_manager' (b6f50e86-60ad-4613-b1f5-65fcf17ece96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:54 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d1d58af8-9ac5-476e-973a-06a735b22cf3 tempest-CreateVolumesFromImageTest-711336980 None] Created volume successfully. Sep 23 12:53:54 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.313s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:53:54 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] Deleted volume successfully. Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b12d8583-86c9-420b-9526-837c42bd2e00 tempest-VolumeDependencyTests-619904691 None] Lock "cinder-48141d5b-0a5e-41fd-b022-c66578033080-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:54 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.295s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:53:54 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] Deleted volume successfully. Sep 23 12:53:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4cba6818-123c-48e7-9538-bc8657188239 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-b1c80ad7-adbf-4f8a-b5a6-4ee3f13e631f-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:55 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c 1073741824" returned: 0 in 0.447s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:55 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c Sep 23 12:53:55 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "cinder-fcd6ccec-4626-4dbf-a905-90e768d97852-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-fcd6ccec-4626-4dbf-a905-90e768d97852-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "cinder-quobyte-fcd6ccec-4626-4dbf-a905-90e768d97852" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:55 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c" returned: 0 in 0.301s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-quobyte-fcd6ccec-4626-4dbf-a905-90e768d97852" acquired by "delete_volume" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.027s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-452649023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950c426c-7493-4a95-8604-fdd0e137f6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dcf614296ad4488aa92238a8953453f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:53Z,use_quota=True,user_id='6b4e175331a748c296ddee54abd770de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Creating volume 950c426c-7493-4a95-8604-fdd0e137f6a0 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:55 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-950c426c-7493-4a95-8604-fdd0e137f6a0 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee6d495-ed58-4288-b98c-3afd656e4932]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcd6ccec-4626-4dbf-a905-90e768d97852 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:55 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-950c426c-7493-4a95-8604-fdd0e137f6a0 1073741824 Sep 23 12:53:55 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c576947-4bb1-43fb-9d71-250de3a4f1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c387d7ac-8227-4eed-a4f8-6d668fb82a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:55 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Volume volume-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c (592568b0-8ed2-43f5-a9f8-6a2efcfccf8c): created successfully Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c387d7ac-8227-4eed-a4f8-6d668fb82a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Flow 'volume_create_manager' (b16320cc-59c4-4228-96fd-9b94c6d95880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:55 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-2787f82c-11c8-43a2-ab89-71c221a5a09e tempest-CreateVolumesFromImageTest-711336980 None] Created volume successfully. Sep 23 12:53:55 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcd6ccec-4626-4dbf-a905-90e768d97852 Sep 23 12:53:55 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:55 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcd6ccec-4626-4dbf-a905-90e768d97852" returned: 0 in 0.450s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcd6ccec-4626-4dbf-a905-90e768d97852 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:55 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcd6ccec-4626-4dbf-a905-90e768d97852 Sep 23 12:53:55 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:55 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-950c426c-7493-4a95-8604-fdd0e137f6a0 1073741824" returned: 0 in 0.528s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-950c426c-7493-4a95-8604-fdd0e137f6a0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:56 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-950c426c-7493-4a95-8604-fdd0e137f6a0 Sep 23 12:53:56 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:56 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcd6ccec-4626-4dbf-a905-90e768d97852" returned: 0 in 0.311s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-quobyte-fcd6ccec-4626-4dbf-a905-90e768d97852" released by "delete_volume" :: held 0.825s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:56 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-950c426c-7493-4a95-8604-fdd0e137f6a0" returned: 0 in 0.288s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.554s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-417577023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d56b11-5571-4045-b648-6262a1604636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dcf614296ad4488aa92238a8953453f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:53Z,use_quota=True,user_id='6b4e175331a748c296ddee54abd770de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Creating volume 23d56b11-5571-4045-b648-6262a1604636 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:56 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-23d56b11-5571-4045-b648-6262a1604636 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:56 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-23d56b11-5571-4045-b648-6262a1604636 1073741824 Sep 23 12:53:56 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfeef3e-0b8c-419c-b9df-d58f8a93775a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-950c426c-7493-4a95-8604-fdd0e137f6a0', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d374a894-bc22-4faf-a94f-50455b000678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] Created reservations ['4bc06059-9549-429a-a183-d39ce0671a97', '6e8b31b0-aa30-4563-9c0c-e9d175f137bc', '5d4700c1-819a-4563-a373-7d79359ea857', 'b590f179-659f-41fa-a7a7-265601c80bad'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:53:56 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Volume volume-950c426c-7493-4a95-8604-fdd0e137f6a0 (950c426c-7493-4a95-8604-fdd0e137f6a0): created successfully Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d374a894-bc22-4faf-a94f-50455b000678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Flow 'volume_create_manager' (d53d1ec0-6918-49fd-aa04-e29d9d267f2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:56 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0feda11a-340a-47ff-ab26-b50cd5dc33c5 tempest-CreateVolumesFromImageTest-711336980 None] Created volume successfully. Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:56 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:53:56 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "cinder-5f6052bc-95f3-4702-a15c-66429d64b2fa-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-5f6052bc-95f3-4702-a15c-66429d64b2fa-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "cinder-quobyte-5f6052bc-95f3-4702-a15c-66429d64b2fa" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-quobyte-5f6052bc-95f3-4702-a15c-66429d64b2fa" acquired by "delete_volume" :: waited 0.028s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25702ad-b07f-439c-b2d7-f73f6bf2fc2e]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f6052bc-95f3-4702-a15c-66429d64b2fa {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:56 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.336s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:53:56 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] Deleted volume successfully. Sep 23 12:53:56 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f6052bc-95f3-4702-a15c-66429d64b2fa Sep 23 12:53:56 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-dd1d4ae2-e203-41ee-ab91-83ce46074165 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-fcd6ccec-4626-4dbf-a905-90e768d97852-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:56 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-23d56b11-5571-4045-b648-6262a1604636 1073741824" returned: 0 in 0.665s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-23d56b11-5571-4045-b648-6262a1604636 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:57 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-23d56b11-5571-4045-b648-6262a1604636 Sep 23 12:53:57 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:57 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f6052bc-95f3-4702-a15c-66429d64b2fa" returned: 0 in 0.482s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f6052bc-95f3-4702-a15c-66429d64b2fa {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:57 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f6052bc-95f3-4702-a15c-66429d64b2fa Sep 23 12:53:57 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:57 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-23d56b11-5571-4045-b648-6262a1604636" returned: 0 in 0.323s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.108s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-35038557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818124f9-c578-406b-9fdf-09a435c3d63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e226d987edf419a959d71bb9c4ddf90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:53:54Z,use_quota=True,user_id='cae128272f00499fb10c648daf47bdbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Creating volume 818124f9-c578-406b-9fdf-09a435c3d63c {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:53:57 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-818124f9-c578-406b-9fdf-09a435c3d63c 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05eb724-3863-42b8-838f-ff4e08b938df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23d56b11-5571-4045-b648-6262a1604636', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa5deb5-a8d6-49db-904c-e07e896be947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:57 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-818124f9-c578-406b-9fdf-09a435c3d63c 1073741824 Sep 23 12:53:57 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:57 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Volume volume-23d56b11-5571-4045-b648-6262a1604636 (23d56b11-5571-4045-b648-6262a1604636): created successfully Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa5deb5-a8d6-49db-904c-e07e896be947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Flow 'volume_create_manager' (7c7fbc9d-57a4-4051-989e-9f13cc7dddd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:57 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d8a67883-fccf-47d7-b4f4-abc4634eea25 tempest-CreateVolumesFromImageTest-711336980 None] Created volume successfully. Sep 23 12:53:57 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-5f6052bc-95f3-4702-a15c-66429d64b2fa" returned: 0 in 0.281s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-quobyte-5f6052bc-95f3-4702-a15c-66429d64b2fa" released by "delete_volume" :: held 0.820s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Created reservations ['d00ea8dd-a89a-486a-8311-8fc8f90b49e3', '0851a7ad-8bc6-4138-9bcc-ded4e7cdda6e', '797e8d76-0f22-4e10-bb67-65b09f6d2cd7', 'ad8a5f9b-5355-44fd-ae15-55e632050517'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:57 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:53:57 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "cinder-99e0384c-588f-4a18-9b85-24faa5e7e421-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-99e0384c-588f-4a18-9b85-24faa5e7e421-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "cinder-quobyte-99e0384c-588f-4a18-9b85-24faa5e7e421" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-quobyte-99e0384c-588f-4a18-9b85-24faa5e7e421" acquired by "delete_volume" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:57 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.318s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:53:57 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Deleted volume successfully. Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3091382-47e9-4f81-8ebe-5d0aea3787e9]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99e0384c-588f-4a18-9b85-24faa5e7e421 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4fcfe6e5-4710-4b34-b9a0-ff154dc167f4 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-5f6052bc-95f3-4702-a15c-66429d64b2fa-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:57 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-818124f9-c578-406b-9fdf-09a435c3d63c 1073741824" returned: 0 in 0.670s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-818124f9-c578-406b-9fdf-09a435c3d63c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:58 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-818124f9-c578-406b-9fdf-09a435c3d63c Sep 23 12:53:58 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:58 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99e0384c-588f-4a18-9b85-24faa5e7e421 Sep 23 12:53:58 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "cinder-23d56b11-5571-4045-b648-6262a1604636-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-23d56b11-5571-4045-b648-6262a1604636-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "cinder-quobyte-23d56b11-5571-4045-b648-6262a1604636" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-quobyte-23d56b11-5571-4045-b648-6262a1604636" acquired by "delete_volume" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b132c1f-cbb4-4562-9ce7-b5069a7ec930]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-23d56b11-5571-4045-b648-6262a1604636 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:58 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-23d56b11-5571-4045-b648-6262a1604636 Sep 23 12:53:58 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:58 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-818124f9-c578-406b-9fdf-09a435c3d63c" returned: 0 in 0.403s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:58 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99e0384c-588f-4a18-9b85-24faa5e7e421" returned: 0 in 0.494s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99e0384c-588f-4a18-9b85-24faa5e7e421 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5caa0283-da56-4883-823c-334dbd1008c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-818124f9-c578-406b-9fdf-09a435c3d63c', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907d7dde-ea71-497b-b8f7-b792be228102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:53:58 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99e0384c-588f-4a18-9b85-24faa5e7e421 Sep 23 12:53:58 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:58 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Volume volume-818124f9-c578-406b-9fdf-09a435c3d63c (818124f9-c578-406b-9fdf-09a435c3d63c): created successfully Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907d7dde-ea71-497b-b8f7-b792be228102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Flow 'volume_create_manager' (34888197-de23-432a-80dd-e5315dfaee02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:53:58 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-e0d33d50-46d5-463d-bff5-44c70118b634 tempest-ProjectReaderTests-1972495790 None] Created volume successfully. Sep 23 12:53:58 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-23d56b11-5571-4045-b648-6262a1604636" returned: 0 in 0.381s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-23d56b11-5571-4045-b648-6262a1604636 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:58 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-23d56b11-5571-4045-b648-6262a1604636 Sep 23 12:53:58 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:58 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-99e0384c-588f-4a18-9b85-24faa5e7e421" returned: 0 in 0.297s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-quobyte-99e0384c-588f-4a18-9b85-24faa5e7e421" released by "delete_volume" :: held 0.853s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] Created reservations ['7b777731-42e1-436c-8074-2aa88a09a7bf', '4c1f0da1-c91f-4c08-82b2-78845d80af95', '0aa31a40-9312-4315-ad0a-a18d1cecd6b3', 'b0b67101-fa2b-4647-9b18-c1693ecd0f7a'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:58 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:53:58 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:58 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-23d56b11-5571-4045-b648-6262a1604636" returned: 0 in 0.287s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:58 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-quobyte-23d56b11-5571-4045-b648-6262a1604636" released by "delete_volume" :: held 0.744s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "cinder-46cc4067-1385-441c-8002-db79cad1986a-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-46cc4067-1385-441c-8002-db79cad1986a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] Created reservations ['6153c639-f3ea-4a49-b5b3-fa01a62acc08', '33a08ec0-43ae-4a74-9cae-19e3da4dc7fd', '8afaeb2a-c2e0-445e-a656-e5fa417957e7', '54d4c5cb-9922-4281-b115-59867d978741'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "cinder-quobyte-46cc4067-1385-441c-8002-db79cad1986a" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-quobyte-46cc4067-1385-441c-8002-db79cad1986a" acquired by "delete_volume" :: waited 0.037s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:59 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.311s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:53:59 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] Deleted volume successfully. Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1231b608-dd18-41db-bcd2-8f6b631fcf71]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-46cc4067-1385-441c-8002-db79cad1986a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ff9c6bab-db98-42c7-b682-34c013e0cb4a tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-99e0384c-588f-4a18-9b85-24faa5e7e421-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:59 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:53:59 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:59 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-46cc4067-1385-441c-8002-db79cad1986a Sep 23 12:53:59 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "cinder-950c426c-7493-4a95-8604-fdd0e137f6a0-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-950c426c-7493-4a95-8604-fdd0e137f6a0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "cinder-quobyte-950c426c-7493-4a95-8604-fdd0e137f6a0" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-quobyte-950c426c-7493-4a95-8604-fdd0e137f6a0" acquired by "delete_volume" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8aacb4-05c5-490c-bd63-8d0e78ef5b01]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-950c426c-7493-4a95-8604-fdd0e137f6a0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:59 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-46cc4067-1385-441c-8002-db79cad1986a" returned: 0 in 0.528s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-46cc4067-1385-441c-8002-db79cad1986a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:53:59 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.499s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:53:59 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-950c426c-7493-4a95-8604-fdd0e137f6a0 Sep 23 12:53:59 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:59 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] Deleted volume successfully. Sep 23 12:53:59 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-46cc4067-1385-441c-8002-db79cad1986a Sep 23 12:53:59 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-149fce9d-f5c7-4917-bb6e-205574fb7b66 tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-23d56b11-5571-4045-b648-6262a1604636-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] Acquiring lock "cinder-818124f9-c578-406b-9fdf-09a435c3d63c-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] Lock "cinder-818124f9-c578-406b-9fdf-09a435c3d63c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:53:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] Acquiring lock "cinder-quobyte-818124f9-c578-406b-9fdf-09a435c3d63c" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] Lock "cinder-quobyte-818124f9-c578-406b-9fdf-09a435c3d63c" acquired by "delete_volume" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[86534fa7-8f92-4859-9477-9b72ebd99b1f]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-818124f9-c578-406b-9fdf-09a435c3d63c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:00 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-46cc4067-1385-441c-8002-db79cad1986a" returned: 0 in 0.363s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-quobyte-46cc4067-1385-441c-8002-db79cad1986a" released by "delete_volume" :: held 0.959s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:00 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-950c426c-7493-4a95-8604-fdd0e137f6a0" returned: 0 in 0.530s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-950c426c-7493-4a95-8604-fdd0e137f6a0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:00 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-818124f9-c578-406b-9fdf-09a435c3d63c Sep 23 12:54:00 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:00 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-950c426c-7493-4a95-8604-fdd0e137f6a0 Sep 23 12:54:00 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] Created reservations ['cd5ddc81-1620-46de-9823-381b3ab5d1a9', 'f3348f08-dc1e-482c-aa53-28cb8585387b', 'd8eb0ada-e4de-4550-bf16-96e7dbd2d24b', '62e93a0a-3770-47cc-85bd-81fd835ff7a7'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:00 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:00 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:00 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-818124f9-c578-406b-9fdf-09a435c3d63c" returned: 0 in 0.443s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-818124f9-c578-406b-9fdf-09a435c3d63c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:00 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-818124f9-c578-406b-9fdf-09a435c3d63c Sep 23 12:54:00 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:00 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-950c426c-7493-4a95-8604-fdd0e137f6a0" returned: 0 in 0.328s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-quobyte-950c426c-7493-4a95-8604-fdd0e137f6a0" released by "delete_volume" :: held 0.918s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] Created reservations ['3fdb6152-5939-4125-8486-929354334518', 'fc37188d-0541-45a3-aa38-a844e2ee2929', '113886aa-d03a-4dc9-aae3-026971bb5dea', '3ee39797-4a8c-400c-8ff2-8ef40727bf73'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:00 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.340s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:00 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] Deleted volume successfully. Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0d8c39b5-da35-4402-9f38-d1eee1a8a519 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-46cc4067-1385-441c-8002-db79cad1986a-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:00 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:00 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:00 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-818124f9-c578-406b-9fdf-09a435c3d63c" returned: 0 in 0.328s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] Lock "cinder-quobyte-818124f9-c578-406b-9fdf-09a435c3d63c" released by "delete_volume" :: held 0.826s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] Created reservations ['d5bdab60-1664-44b2-bb72-98c3b3a3e4d9', '945f8161-5b0d-4c76-899f-2c94250062fb', '34c9450f-766f-476a-8da7-99b5fc9213c2', 'a3fb4f2f-a552-465c-bda9-19b364824d63'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:00 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.272s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:00 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:00 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] Deleted volume successfully. Sep 23 12:54:01 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:01 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-027d3ce5-aaf3-4f7e-bb6b-5d12c42fab3e tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-950c426c-7493-4a95-8604-fdd0e137f6a0-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:01 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.292s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:01 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] Deleted volume successfully. Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fc6d90d7-b257-4443-ae70-fdd57a89aec3 tempest-ProjectReaderTests-1972495790 None] Lock "cinder-818124f9-c578-406b-9fdf-09a435c3d63c-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "cinder-9f58d8f7-9e15-40ee-aaa5-42601b6387bf-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-9f58d8f7-9e15-40ee-aaa5-42601b6387bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "cinder-quobyte-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-quobyte-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "cinder-quobyte-9f58d8f7-9e15-40ee-aaa5-42601b6387bf" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-quobyte-9f58d8f7-9e15-40ee-aaa5-42601b6387bf" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] Deleting offline snapshot 9f58d8f7-9e15-40ee-aaa5-42601b6387bf of volume 667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] snapshot_file for this snap is: volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[348bab9b-7446-431c-bc1a-7e3791c2211c]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:01 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf Sep 23 12:54:01 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Flow 'volume_create_manager' (862a7faf-05ba-457c-ac73-029929d6762c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef3c42f-46f8-434c-8515-e1de7ec143dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "cinder-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef3c42f-46f8-434c-8515-e1de7ec143dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1657514900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e226d987edf419a959d71bb9c4ddf90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:02Z,use_quota=True,user_id='cae128272f00499fb10c648daf47bdbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e189f610-32ee-4f25-95c1-32da9a6e9022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e189f610-32ee-4f25-95c1-32da9a6e9022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8273e86d-c7f5-4d56-af7f-a80f3d1674c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8273e86d-c7f5-4d56-af7f-a80f3d1674c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a', 'volume_name': 'volume-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31fbc0dd-a1e1-4a1a-8e3a-0db4ed616690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31fbc0dd-a1e1-4a1a-8e3a-0db4ed616690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d228c86-4272-4a78-a907-05fcc594a933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:01 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Volume 4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a', 'volume_size': 1} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1657514900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e226d987edf419a959d71bb9c4ddf90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:02Z,use_quota=True,user_id='cae128272f00499fb10c648daf47bdbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Creating volume 4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:54:01 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:01 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a 1073741824 Sep 23 12:54:01 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "cinder-quobyte-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-quobyte-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c" acquired by "delete_volume" :: waited 0.015s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:01 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf" returned: 0 in 0.494s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f2cadb-a408-48c1-a1d0-ffead45311cb]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[3520ee1b-e9ce-46e3-b806-6a944ccbe6f0]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:02 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c Sep 23 12:54:02 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:02 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b Sep 23 12:54:02 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:02 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c" returned: 0 in 0.469s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:02 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:02 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b" returned: 0 in 0.489s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:02 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a 1073741824" returned: 0 in 0.632s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:02 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:02 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf Sep 23 12:54:02 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Flow 'volume_create_manager' (f2aebb80-6e0f-4eec-b739-d9b5afddf934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c66c94-bb2a-473c-b8fc-53ae0acfac88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c66c94-bb2a-473c-b8fc-53ae0acfac88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b87ea6-5549-4138-b229-a9539383d458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33cec69dc2c44098afe76f795c7484c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:02Z,use_quota=True,user_id='1eb683f1708a4fc1b4e0332a79133d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2d392d-bda7-440e-94da-0463008bdfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2d392d-bda7-440e-94da-0463008bdfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92aaeef9-a833-49e8-b33c-610a3d099889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG cinder.image.glance [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Creating Keystone auth plugin from conf {{(pid=86085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:02 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a Sep 23 12:54:02 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:02 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c" returned: 0 in 0.280s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-quobyte-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c" released by "delete_volume" :: held 0.820s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] Created reservations ['941634f9-4109-4b8e-bfa9-d0cd730ab022', '5600b487-72aa-4b10-8016-e47f96ba1085', '258ab700-dde8-4a15-ae91-f278ece154a4', '054c3c8d-d5bd-4290-a65c-5988f8384b0a'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:02 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf" returned: 0 in 0.461s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:03 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:03 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:03 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:03 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "cinder-e22d2908-2c4e-4222-8e8e-955ebbd5bae8-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:03 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a" returned: 0 in 0.396s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d228c86-4272-4a78-a907-05fcc594a933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d1b8b1-b77c-4a4d-ab64-3828201b5b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92aaeef9-a833-49e8-b33c-610a3d099889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f7b87ea6-5549-4138-b229-a9539383d458', 'volume_name': 'volume-f7b87ea6-5549-4138-b229-a9539383d458', 'volume_size': 1, 'image_id': '59258c5d-4dee-4ec8-9ef8-1e2414d76999', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59258c5d-4dee-4ec8-9ef8-1e2414d76999', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a4069c2e1f1583722c813d0f4bfa5af', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b33cec69dc2c44098afe76f795c7484c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '832f6b048d9915a65d82a8abb3f62ba7a78360f27549e8dc1cee1e1b79c35e1112804bf1a779fc47e358651310994eebcd273670893cc6dba867e26e639c2d81', 'id': '59258c5d-4dee-4ec8-9ef8-1e2414d76999', 'created_at': datetime.datetime(2026, 9, 23, 10, 53, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 54, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59258c5d-4dee-4ec8-9ef8-1e2414d76999/file', 'properties': {}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cba5bb3-ac23-45da-af8e-b86ea8a4285a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cba5bb3-ac23-45da-af8e-b86ea8a4285a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637a1abc-1ec6-435e-8cb4-829b2132ff3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:03 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Volume f7b87ea6-5549-4138-b229-a9539383d458: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f7b87ea6-5549-4138-b229-a9539383d458', 'volume_size': 1, 'image_id': '59258c5d-4dee-4ec8-9ef8-1e2414d76999', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59258c5d-4dee-4ec8-9ef8-1e2414d76999', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a4069c2e1f1583722c813d0f4bfa5af', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b33cec69dc2c44098afe76f795c7484c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '832f6b048d9915a65d82a8abb3f62ba7a78360f27549e8dc1cee1e1b79c35e1112804bf1a779fc47e358651310994eebcd273670893cc6dba867e26e639c2d81', 'id': '59258c5d-4dee-4ec8-9ef8-1e2414d76999', 'created_at': datetime.datetime(2026, 9, 23, 10, 53, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 54, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59258c5d-4dee-4ec8-9ef8-1e2414d76999/file', 'properties': {}}, 'image_service': } Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Trying to clone f7b87ea6-5549-4138-b229-a9539383d458 from image 59258c5d-4dee-4ec8-9ef8-1e2414d76999 at location (None, [{'url': 'file:///opt/stack/data/glance/images/59258c5d-4dee-4ec8-9ef8-1e2414d76999', 'metadata': {}}]). {{(pid=86085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-e22d2908-2c4e-4222-8e8e-955ebbd5bae8-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:03 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Volume volume-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a (4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a): created successfully Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d1b8b1-b77c-4a4d-ab64-3828201b5b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Flow 'volume_create_manager' (862a7faf-05ba-457c-ac73-029929d6762c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "cinder-quobyte-e22d2908-2c4e-4222-8e8e-955ebbd5bae8" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:03 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-4bb4ce15-78c1-49a5-9c61-7902ee4d5a53 tempest-ProjectReaderTests-1972495790 None] Created volume successfully. Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-quobyte-e22d2908-2c4e-4222-8e8e-955ebbd5bae8" acquired by "delete_volume" :: waited 0.024s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[615c28d2-99d8-4452-8474-05628cdc2afc]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e22d2908-2c4e-4222-8e8e-955ebbd5bae8 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 12:54:03 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Image download 0.00 MB at 0.00 MB/s Sep 23 12:54:03 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.360s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16f6033-b88a-42d8-b6e0-b2dd3cecc7d8]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:03 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] Deleted volume successfully. Sep 23 12:54:03 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e22d2908-2c4e-4222-8e8e-955ebbd5bae8 Sep 23 12:54:03 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:03 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b.9f58d8f7-9e15-40ee-aaa5-42601b6387bf" returned: 0 in 0.381s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8c90237d-0de9-4dd7-906b-6508cf361c03 tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-592568b0-8ed2-43f5-a9f8-6a2efcfccf8c-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-quobyte-9f58d8f7-9e15-40ee-aaa5-42601b6387bf" released by "_delete_snapshot" :: held 1.983s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-quobyte-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b" released by "delete_snapshot" :: held 2.034s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:03 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD Sep 23 12:54:03 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] Created reservations ['e8ea8c95-a77c-4786-b501-5be986d86bce', '0a12c6c8-f578-431f-9fb7-5cd8992b9766', '324f0143-c3ca-494f-8130-883554acd945', '44a826ed-c2b1-4f66-b805-9ad615804957'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:03 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] Delete snapshot completed successfully. Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-08c20e70-4d26-406d-9ed2-5b2b55a27912 tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-9f58d8f7-9e15-40ee-aaa5-42601b6387bf-delete_snapshot" released by "delete_snapshot" :: held 2.196s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:03 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e22d2908-2c4e-4222-8e8e-955ebbd5bae8" returned: 0 in 0.450s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e22d2908-2c4e-4222-8e8e-955ebbd5bae8 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:03 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:03 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e22d2908-2c4e-4222-8e8e-955ebbd5bae8 Sep 23 12:54:03 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD" returned: 0 in 0.396s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] Acquiring lock "cinder-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:03 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD Sep 23 12:54:03 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] Lock "cinder-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] Acquiring lock "cinder-quobyte-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] Lock "cinder-quobyte-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a" acquired by "delete_volume" :: waited 0.015s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e376bc07-801a-493f-92ca-06196fc0a6bb]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:03 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-e22d2908-2c4e-4222-8e8e-955ebbd5bae8" returned: 0 in 0.299s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-quobyte-e22d2908-2c4e-4222-8e8e-955ebbd5bae8" released by "delete_volume" :: held 0.823s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] Created reservations ['4beb29fa-8c06-42d0-a317-9ca8f61251f8', 'bc067327-589e-4ffb-b2a5-78e37dd757a8', '1ea9d21d-18aa-4d7e-b609-53e2c3d4ea18', 'e4a59564-97bd-4ad6-864f-dc86b443a5f2'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:04 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a Sep 23 12:54:04 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:04 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD" returned: 1 in 0.458s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Temporary image 59258c5d-4dee-4ec8-9ef8-1e2414d76999 is fetched for user 1eb683f1708a4fc1b4e0332a79133d88. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 12:54:04 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:04 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "cinder-a023256f-2180-4a0e-b828-f8625791a1ef-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-a023256f-2180-4a0e-b828-f8625791a1ef-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[772ad384-1769-41e8-bb38-b45984d3755b]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "cinder-quobyte-a023256f-2180-4a0e-b828-f8625791a1ef" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-quobyte-a023256f-2180-4a0e-b828-f8625791a1ef" acquired by "delete_volume" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:04 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a" returned: 0 in 0.450s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[062e4dbe-46aa-480f-9e8e-4e4446d5ae73]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a023256f-2180-4a0e-b828-f8625791a1ef {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:04 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a Sep 23 12:54:04 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:04 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD Sep 23 12:54:04 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:04 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.402s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:04 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] Deleted volume successfully. Sep 23 12:54:04 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a023256f-2180-4a0e-b828-f8625791a1ef Sep 23 12:54:04 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "cinder-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d7af42c6-6d7a-4b92-b658-da2132b59e20 tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-e22d2908-2c4e-4222-8e8e-955ebbd5bae8-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:04 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a" returned: 0 in 0.313s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "cinder-quobyte-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] Lock "cinder-quobyte-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a" released by "delete_volume" :: held 0.813s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-quobyte-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b" acquired by "delete_volume" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:04 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD" returned: 0 in 0.462s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[068ae5de-ff13-4880-808c-feb21db648d5]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] Created reservations ['4e6a5fc4-5af3-4c75-9255-a424a988354b', '16322e0e-0e11-4151-b99a-4f40724c22ea', '8b352816-1342-4841-8e8f-c10788caffd8', '5fc8689e-726b-4f9d-9096-1e5023d80523'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:04 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD Sep 23 12:54:04 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b Sep 23 12:54:04 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:04 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:05 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a023256f-2180-4a0e-b828-f8625791a1ef" returned: 0 in 0.580s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a023256f-2180-4a0e-b828-f8625791a1ef {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:05 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:05 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:05 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a023256f-2180-4a0e-b828-f8625791a1ef Sep 23 12:54:05 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:05 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD" returned: 1 in 0.436s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b87ea6-5549-4138-b229-a9539383d458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33cec69dc2c44098afe76f795c7484c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:02Z,use_quota=True,user_id='1eb683f1708a4fc1b4e0332a79133d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Creating volume f7b87ea6-5549-4138-b229-a9539383d458 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:54:05 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f7b87ea6-5549-4138-b229-a9539383d458 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:05 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:05 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f7b87ea6-5549-4138-b229-a9539383d458 1073741824 Sep 23 12:54:05 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.326s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:05 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] Deleted volume successfully. Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ddfba654-3895-4750-a737-43fa7d3ce9e7 tempest-ProjectReaderTests-1972495790 None] Lock "cinder-4710cfda-ebc4-46ae-a7ff-c1397fc0fd3a-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:05 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b" returned: 0 in 0.600s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:05 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:05 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b Sep 23 12:54:05 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-a023256f-2180-4a0e-b828-f8625791a1ef" returned: 0 in 0.457s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-quobyte-a023256f-2180-4a0e-b828-f8625791a1ef" released by "delete_volume" :: held 1.111s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] Created reservations ['1851e9c2-e639-48e6-8454-3e7e0bfd2652', '9aa869e3-bf66-4f69-9fd8-907057c61c6e', 'b3a7e8f9-a49b-4048-bd08-aa14fefd5c94', 'a1bf7097-9a55-4d21-a3f1-99f2d40b7338'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:05 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:05 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:05 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b" returned: 0 in 0.359s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-quobyte-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b" released by "delete_volume" :: held 1.049s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] Created reservations ['225054c1-9675-4b17-a881-d62eaf765c46', 'bccfee6f-ccc0-42da-94b5-5e16a6106860', '5014c163-2e4b-4446-b195-063ba8005a57', '0f5a0c8c-7d54-4358-940d-7e8a38e46864'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:05 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f7b87ea6-5549-4138-b229-a9539383d458 1073741824" returned: 0 in 0.653s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f7b87ea6-5549-4138-b229-a9539383d458 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:06 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f7b87ea6-5549-4138-b229-a9539383d458 Sep 23 12:54:06 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:06 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:06 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:06 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.309s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:06 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:06 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] Deleted volume successfully. Sep 23 12:54:06 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c90915b9-79f8-4ae0-917e-dcc89cd0b7a4 tempest-CreateVolumesFromImageTest-711336980 None] Lock "cinder-a023256f-2180-4a0e-b828-f8625791a1ef-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:06 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:06 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.284s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:06 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f7b87ea6-5549-4138-b229-a9539383d458" returned: 0 in 0.317s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:06 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:54:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:06 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] Deleted volume successfully. Sep 23 12:54:06 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-18c6e939-8300-4650-8bec-95272919cf9c tempest-CreateVolumesFromSnapshotTest-92252839 None] Lock "cinder-667ef0b3-6c7c-4d6f-8ed3-a03d3ff2992b-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:06 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Attempting download of 59258c5d-4dee-4ec8-9ef8-1e2414d76999 ((None, [{'url': 'file:///opt/stack/data/glance/images/59258c5d-4dee-4ec8-9ef8-1e2414d76999', 'metadata': {}}])) to volume f7b87ea6-5549-4138-b229-a9539383d458. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 12:54:06 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1be58bd-b728-4718-be35-ca1f4cb2cdae]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59258c5d-4dee-4ec8-9ef8-1e2414d76999_jo3ck_di {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:06 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59258c5d-4dee-4ec8-9ef8-1e2414d76999_jo3ck_di Sep 23 12:54:06 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:06 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59258c5d-4dee-4ec8-9ef8-1e2414d76999_jo3ck_di" returned: 0 in 0.365s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59258c5d-4dee-4ec8-9ef8-1e2414d76999_jo3ck_di {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:06 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59258c5d-4dee-4ec8-9ef8-1e2414d76999_jo3ck_di Sep 23 12:54:06 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:07 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59258c5d-4dee-4ec8-9ef8-1e2414d76999_jo3ck_di" returned: 1 in 0.402s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59258c5d-4dee-4ec8-9ef8-1e2414d76999_jo3ck_di' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:54:07 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fea12b0-355b-43a6-aaa0-4b04c59ed0b0]: (4, 'raw') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:07 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD Sep 23 12:54:07 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:07 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD" returned: 0 in 0.458s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:07 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD Sep 23 12:54:07 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:08 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD" returned: 1 in 0.466s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 12:54:08 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] 59258c5d-4dee-4ec8-9ef8-1e2414d76999 was raw, converting to qcow2 {{(pid=86085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 12:54:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f7b87ea6-5549-4138-b229-a9539383d458 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:08 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f7b87ea6-5549-4138-b229-a9539383d458 Sep 23 12:54:08 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:08 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f7b87ea6-5549-4138-b229-a9539383d458" returned: 0 in 0.703s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:08 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_59258c5d-4dee-4ec8-9ef8-1e2414d76999_kgydsyo1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f7b87ea6-5549-4138-b229-a9539383d458 {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:54:08 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 12:54:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f7b87ea6-5549-4138-b229-a9539383d458 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:08 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f7b87ea6-5549-4138-b229-a9539383d458 1G Sep 23 12:54:08 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:09 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f7b87ea6-5549-4138-b229-a9539383d458 1G" returned: 0 in 0.456s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:09 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Downloaded image 59258c5d-4dee-4ec8-9ef8-1e2414d76999 ((None, [{'url': 'file:///opt/stack/data/glance/images/59258c5d-4dee-4ec8-9ef8-1e2414d76999', 'metadata': {}}])) to volume f7b87ea6-5549-4138-b229-a9539383d458 successfully. {{(pid=86085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 12:54:09 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Temporary image 59258c5d-4dee-4ec8-9ef8-1e2414d76999 for user 1eb683f1708a4fc1b4e0332a79133d88 is deleted. {{(pid=86085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 12:54:09 devstack cinder-volume[86085]: DEBUG cinder.volume.volume_utils [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Marking volume f7b87ea6-5549-4138-b229-a9539383d458 as bootable. {{(pid=86085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 12:54:09 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Copying metadata from image 59258c5d-4dee-4ec8-9ef8-1e2414d76999 to f7b87ea6-5549-4138-b229-a9539383d458. {{(pid=86085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 12:54:09 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Creating volume glance metadata for volume f7b87ea6-5549-4138-b229-a9539383d458 backed by image 59258c5d-4dee-4ec8-9ef8-1e2414d76999 with: {'image_id': '59258c5d-4dee-4ec8-9ef8-1e2414d76999', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2a4069c2e1f1583722c813d0f4bfa5af', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 12:54:09 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637a1abc-1ec6-435e-8cb4-829b2132ff3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7b87ea6-5549-4138-b229-a9539383d458', 'volume_size': 1, 'image_id': '59258c5d-4dee-4ec8-9ef8-1e2414d76999', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59258c5d-4dee-4ec8-9ef8-1e2414d76999', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a4069c2e1f1583722c813d0f4bfa5af', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b33cec69dc2c44098afe76f795c7484c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '832f6b048d9915a65d82a8abb3f62ba7a78360f27549e8dc1cee1e1b79c35e1112804bf1a779fc47e358651310994eebcd273670893cc6dba867e26e639c2d81', 'id': '59258c5d-4dee-4ec8-9ef8-1e2414d76999', 'created_at': datetime.datetime(2026, 9, 23, 10, 53, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 10, 54, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59258c5d-4dee-4ec8-9ef8-1e2414d76999/file', 'properties': {}}, 'image_service': }' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:09 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69012efd-37e8-403a-996d-c80a5fbb4713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:09 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Volume volume-f7b87ea6-5549-4138-b229-a9539383d458 (f7b87ea6-5549-4138-b229-a9539383d458): created successfully Sep 23 12:54:09 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69012efd-37e8-403a-996d-c80a5fbb4713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:09 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Flow 'volume_create_manager' (f2aebb80-6e0f-4eec-b739-d9b5afddf934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:09 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-e0a9a0cb-9f8a-473f-a701-c5d1689bb6b2 tempest-VolumeImageDependencyTests-669423591 None] Created volume successfully. Sep 23 12:54:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] Acquiring lock "cinder-f7b87ea6-5549-4138-b229-a9539383d458-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] Lock "cinder-f7b87ea6-5549-4138-b229-a9539383d458-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] Acquiring lock "cinder-quobyte-f7b87ea6-5549-4138-b229-a9539383d458" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] Lock "cinder-quobyte-f7b87ea6-5549-4138-b229-a9539383d458" acquired by "delete_volume" :: waited 0.026s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:10 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[255a62c7-61f6-45e9-bef2-846078499ceb]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f7b87ea6-5549-4138-b229-a9539383d458 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:10 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f7b87ea6-5549-4138-b229-a9539383d458 Sep 23 12:54:10 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:10 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f7b87ea6-5549-4138-b229-a9539383d458" returned: 0 in 0.535s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f7b87ea6-5549-4138-b229-a9539383d458 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:10 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f7b87ea6-5549-4138-b229-a9539383d458 Sep 23 12:54:10 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Flow 'volume_create_manager' (f738efbf-7cbf-4a11-bdeb-16e070ddcca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:11 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d2cd50-c28e-4877-9866-937c14939216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-f7b87ea6-5549-4138-b229-a9539383d458" returned: 0 in 0.348s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d2cd50-c28e-4877-9866-937c14939216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-499459218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939eb48e-967c-42b4-a4b1-01ef324713b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be34d4d9fe1464eaa3fe29cc43d4e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:11Z,use_quota=True,user_id='589bfc53d34445438684bc84c3696377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d02ec0-cd93-4631-add5-de732763051c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d02ec0-cd93-4631-add5-de732763051c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817b8463-efa3-472e-b8f5-662632f1a71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817b8463-efa3-472e-b8f5-662632f1a71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '939eb48e-967c-42b4-a4b1-01ef324713b8', 'volume_name': 'volume-939eb48e-967c-42b4-a4b1-01ef324713b8', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (709c8eb6-719a-44ca-91ff-dc122736d4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (709c8eb6-719a-44ca-91ff-dc122736d4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33addb9-22cc-44fa-8a74-405fe0bb4e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:11 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Volume 939eb48e-967c-42b4-a4b1-01ef324713b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-939eb48e-967c-42b4-a4b1-01ef324713b8', 'volume_size': 1} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-499459218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939eb48e-967c-42b4-a4b1-01ef324713b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be34d4d9fe1464eaa3fe29cc43d4e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:11Z,use_quota=True,user_id='589bfc53d34445438684bc84c3696377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Creating volume 939eb48e-967c-42b4-a4b1-01ef324713b8 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:54:11 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-939eb48e-967c-42b4-a4b1-01ef324713b8 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] Lock "cinder-quobyte-f7b87ea6-5549-4138-b229-a9539383d458" released by "delete_volume" :: held 1.025s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:11 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-939eb48e-967c-42b4-a4b1-01ef324713b8 1073741824 Sep 23 12:54:11 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] Created reservations ['17d12bc6-102e-4d39-8a06-2c1d16337769', '0bcede9f-0a86-47b7-9b0a-af4308f800c1', '9118755c-4dad-4507-8fa2-fead91af8d47', '46800762-c5ba-453e-ad6b-568b758fe8b3'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:11 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:11 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-b517ff92-54d5-471b-a632-f3d546bdfb11 tempest-ProjectAdminTests-986777959 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4653587341309, 'free_capacity_gb': 1775.4653587341309, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86085) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 12:54:11 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.313s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:11 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] Deleted volume successfully. Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5d52210a-9dd0-400e-8cba-fe9afdca7c55 tempest-VolumeImageDependencyTests-669423591 None] Lock "cinder-f7b87ea6-5549-4138-b229-a9539383d458-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:11 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-939eb48e-967c-42b4-a4b1-01ef324713b8 1073741824" returned: 0 in 0.665s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Flow 'volume_create_manager' (ee722cff-0563-4707-9500-ad636b48b2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9912436b-28fd-4704-9b11-6b56ed1a4623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9912436b-28fd-4704-9b11-6b56ed1a4623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce24f56-c2a9-4f83-8013-8869f1a43a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f980734317460fb14b7d094dc13f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:12Z,use_quota=True,user_id='4536c0adf96f4b5d89169dcf1b795870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee7da4d-ff92-45e1-b8b6-13a281fdd741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee7da4d-ff92-45e1-b8b6-13a281fdd741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6315ed6-d37a-4452-bf5b-2fcc190abc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6315ed6-d37a-4452-bf5b-2fcc190abc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dce24f56-c2a9-4f83-8013-8869f1a43a3c', 'volume_name': 'volume-dce24f56-c2a9-4f83-8013-8869f1a43a3c', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa62a833-68c2-4ab7-b9cd-9bcc774cf1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa62a833-68c2-4ab7-b9cd-9bcc774cf1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072555f6-33b1-45d2-8209-7bd93e78cceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:12 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Volume dce24f56-c2a9-4f83-8013-8869f1a43a3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dce24f56-c2a9-4f83-8013-8869f1a43a3c', 'volume_size': 1} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-939eb48e-967c-42b4-a4b1-01ef324713b8 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:12 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-939eb48e-967c-42b4-a4b1-01ef324713b8 Sep 23 12:54:12 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:12 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-939eb48e-967c-42b4-a4b1-01ef324713b8" returned: 0 in 0.264s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.273s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce24f56-c2a9-4f83-8013-8869f1a43a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f980734317460fb14b7d094dc13f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:12Z,use_quota=True,user_id='4536c0adf96f4b5d89169dcf1b795870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Creating volume dce24f56-c2a9-4f83-8013-8869f1a43a3c {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:54:12 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dce24f56-c2a9-4f83-8013-8869f1a43a3c 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:12 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dce24f56-c2a9-4f83-8013-8869f1a43a3c 1073741824 Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33addb9-22cc-44fa-8a74-405fe0bb4e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-939eb48e-967c-42b4-a4b1-01ef324713b8', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:12 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343d84e6-fe2a-4081-8a5b-39e758810186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:12 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Volume volume-939eb48e-967c-42b4-a4b1-01ef324713b8 (939eb48e-967c-42b4-a4b1-01ef324713b8): created successfully Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343d84e6-fe2a-4081-8a5b-39e758810186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Flow 'volume_create_manager' (f738efbf-7cbf-4a11-bdeb-16e070ddcca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:12 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-6ad6ad02-d8c1-4c7e-b4b7-51ff9c7d73c6 tempest-ProjectReaderTests-580709737 None] Created volume successfully. Sep 23 12:54:12 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dce24f56-c2a9-4f83-8013-8869f1a43a3c 1073741824" returned: 0 in 0.553s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dce24f56-c2a9-4f83-8013-8869f1a43a3c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:12 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dce24f56-c2a9-4f83-8013-8869f1a43a3c Sep 23 12:54:12 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:13 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dce24f56-c2a9-4f83-8013-8869f1a43a3c" returned: 0 in 0.320s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:13 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:54:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072555f6-33b1-45d2-8209-7bd93e78cceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dce24f56-c2a9-4f83-8013-8869f1a43a3c', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e505b2f3-9e76-4834-843a-556917c975b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:13 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Volume volume-dce24f56-c2a9-4f83-8013-8869f1a43a3c (dce24f56-c2a9-4f83-8013-8869f1a43a3c): created successfully Sep 23 12:54:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e505b2f3-9e76-4834-843a-556917c975b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:13 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Flow 'volume_create_manager' (ee722cff-0563-4707-9500-ad636b48b2f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:13 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0dd87183-69bc-4f55-8496-6039880ac0dd tempest-CinderUnicodeTest-1953161923 None] Created volume successfully. Sep 23 12:54:13 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] Acquiring lock "cinder-939eb48e-967c-42b4-a4b1-01ef324713b8-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:13 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] Lock "cinder-939eb48e-967c-42b4-a4b1-01ef324713b8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:13 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] Acquiring lock "cinder-quobyte-939eb48e-967c-42b4-a4b1-01ef324713b8" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:13 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] Lock "cinder-quobyte-939eb48e-967c-42b4-a4b1-01ef324713b8" acquired by "delete_volume" :: waited 0.032s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:13 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7e53c4-5af9-42d3-84ed-4ff771a34351]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-939eb48e-967c-42b4-a4b1-01ef324713b8 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:13 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-939eb48e-967c-42b4-a4b1-01ef324713b8 Sep 23 12:54:13 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:14 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-939eb48e-967c-42b4-a4b1-01ef324713b8" returned: 0 in 0.456s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-939eb48e-967c-42b4-a4b1-01ef324713b8 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:14 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-939eb48e-967c-42b4-a4b1-01ef324713b8 Sep 23 12:54:14 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:14 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-939eb48e-967c-42b4-a4b1-01ef324713b8" returned: 0 in 0.358s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] Lock "cinder-quobyte-939eb48e-967c-42b4-a4b1-01ef324713b8" released by "delete_volume" :: held 0.872s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] Created reservations ['650dabfa-36e0-48e2-b001-95aef97b189a', 'e4567496-cc32-43e8-9c3e-b2f0e0ba6afa', '3df28f49-cdc8-4664-bc68-a07d96099475', 'c5b792c8-3a67-4f42-b37c-5fca57842297'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:14 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:14 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Flow 'volume_create_manager' (434dc83d-62c8-4332-82d8-e24a259d26ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f3764e9-0b09-420d-ac68-eafd06646a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f3764e9-0b09-420d-ac68-eafd06646a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1036527879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce338b85-794e-47cf-adff-a26a251f9af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f980734317460fb14b7d094dc13f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:15Z,use_quota=True,user_id='4536c0adf96f4b5d89169dcf1b795870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495624ee-669a-442b-83d0-264330f4a3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495624ee-669a-442b-83d0-264330f4a3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeca87ec-5b6b-42a6-a755-0904d38679bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeca87ec-5b6b-42a6-a755-0904d38679bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce338b85-794e-47cf-adff-a26a251f9af7', 'volume_name': 'volume-ce338b85-794e-47cf-adff-a26a251f9af7', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccadfbce-172c-4f6f-8dd9-687ce6b516b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccadfbce-172c-4f6f-8dd9-687ce6b516b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6d7c7a-f406-4550-9b85-ab3dd43452bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:14 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Volume ce338b85-794e-47cf-adff-a26a251f9af7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce338b85-794e-47cf-adff-a26a251f9af7', 'volume_size': 1} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1036527879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce338b85-794e-47cf-adff-a26a251f9af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f980734317460fb14b7d094dc13f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:15Z,use_quota=True,user_id='4536c0adf96f4b5d89169dcf1b795870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Creating volume ce338b85-794e-47cf-adff-a26a251f9af7 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:54:14 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:54:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:14 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7 1073741824 Sep 23 12:54:14 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:15 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.310s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:15 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:15 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] Deleted volume successfully. Sep 23 12:54:15 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-1b4a9c26-f320-40c4-8ce0-72486cd1e0d4 tempest-ProjectReaderTests-580709737 None] Lock "cinder-939eb48e-967c-42b4-a4b1-01ef324713b8-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:15 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7 1073741824" returned: 0 in 0.536s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:15 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7 Sep 23 12:54:15 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:15 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7" returned: 0 in 0.291s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:54:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6d7c7a-f406-4550-9b85-ab3dd43452bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce338b85-794e-47cf-adff-a26a251f9af7', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d139c8-d216-4ef7-b4f9-ce929933de3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:15 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Volume volume-ce338b85-794e-47cf-adff-a26a251f9af7 (ce338b85-794e-47cf-adff-a26a251f9af7): created successfully Sep 23 12:54:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d139c8-d216-4ef7-b4f9-ce929933de3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:15 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Flow 'volume_create_manager' (434dc83d-62c8-4332-82d8-e24a259d26ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:15 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-a85f8647-b22c-44ce-8442-3e09c0eabfa0 tempest-CinderUnicodeTest-1953161923 None] Created volume successfully. Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Flow 'volume_create_manager' (c75227d0-d4b1-4e7d-9a0c-8e2de937c2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c3e61f-e081-4220-846d-a2dc2be9ceba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c3e61f-e081-4220-846d-a2dc2be9ceba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1136746327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc234cd-eac7-42c6-b09b-e5b00350ab52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be34d4d9fe1464eaa3fe29cc43d4e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:16Z,use_quota=True,user_id='589bfc53d34445438684bc84c3696377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd722be-073c-4b48-ad78-818a8adf553c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd722be-073c-4b48-ad78-818a8adf553c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e57188f-9283-4330-b0b1-92c1b0f560d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e57188f-9283-4330-b0b1-92c1b0f560d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcc234cd-eac7-42c6-b09b-e5b00350ab52', 'volume_name': 'volume-fcc234cd-eac7-42c6-b09b-e5b00350ab52', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290bbf6c-bc6b-46de-8e67-d425204e56c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290bbf6c-bc6b-46de-8e67-d425204e56c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d5490f-db8e-4744-a3cf-9a283c6a8e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:16 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Volume fcc234cd-eac7-42c6-b09b-e5b00350ab52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcc234cd-eac7-42c6-b09b-e5b00350ab52', 'volume_size': 1} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1136746327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc234cd-eac7-42c6-b09b-e5b00350ab52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be34d4d9fe1464eaa3fe29cc43d4e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:16Z,use_quota=True,user_id='589bfc53d34445438684bc84c3696377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Creating volume fcc234cd-eac7-42c6-b09b-e5b00350ab52 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:54:16 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:54:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcc234cd-eac7-42c6-b09b-e5b00350ab52 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:16 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcc234cd-eac7-42c6-b09b-e5b00350ab52 1073741824 Sep 23 12:54:16 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:17 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcc234cd-eac7-42c6-b09b-e5b00350ab52 1073741824" returned: 0 in 0.648s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcc234cd-eac7-42c6-b09b-e5b00350ab52 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:17 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcc234cd-eac7-42c6-b09b-e5b00350ab52 Sep 23 12:54:17 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Flow 'volume_create_manager' (d20376b9-f31a-4e39-a78b-16898e49c069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (927cf07f-bfc7-4f5c-b4a3-a059a4918dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (927cf07f-bfc7-4f5c-b4a3-a059a4918dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1970475003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e849dc4-c65b-4df6-b5cb-db4f0c468023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fdcd86a5cf44b7bf3afc72ccee4603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:17Z,use_quota=True,user_id='399ebb30c0be43a0b1a2458707bca670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b58a710-847f-4ee1-aca7-1d48c3c1790b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b58a710-847f-4ee1-aca7-1d48c3c1790b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115edc1a-c6cb-4918-869d-ed161e2f46fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115edc1a-c6cb-4918-869d-ed161e2f46fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e849dc4-c65b-4df6-b5cb-db4f0c468023', 'volume_name': 'volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf5d2d6-165f-4a83-9878-b59508163ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf5d2d6-165f-4a83-9878-b59508163ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db2771c-aff6-451a-a857-a807e5d886fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:17 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Volume 7e849dc4-c65b-4df6-b5cb-db4f0c468023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023', 'volume_size': 1} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bacf6675-beeb-4c93-b11a-7d46465ed4a0 tempest-CinderUnicodeTest-1953161923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:17 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcc234cd-eac7-42c6-b09b-e5b00350ab52" returned: 0 in 0.325s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.119s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1970475003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e849dc4-c65b-4df6-b5cb-db4f0c468023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fdcd86a5cf44b7bf3afc72ccee4603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:17Z,use_quota=True,user_id='399ebb30c0be43a0b1a2458707bca670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Creating volume 7e849dc4-c65b-4df6-b5cb-db4f0c468023 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:54:17 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d5490f-db8e-4744-a3cf-9a283c6a8e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcc234cd-eac7-42c6-b09b-e5b00350ab52', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:17 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023 1073741824 Sep 23 12:54:17 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb65453f-a20c-41bd-b734-b625a7451c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:17 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Volume volume-fcc234cd-eac7-42c6-b09b-e5b00350ab52 (fcc234cd-eac7-42c6-b09b-e5b00350ab52): created successfully Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb65453f-a20c-41bd-b734-b625a7451c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Flow 'volume_create_manager' (c75227d0-d4b1-4e7d-9a0c-8e2de937c2b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:17 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-4b21af6e-2f9a-4409-b255-262aadabdb91 tempest-ProjectReaderTests-580709737 None] Created volume successfully. Sep 23 12:54:17 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023 1073741824" returned: 0 in 0.444s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:17 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023 Sep 23 12:54:17 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:18 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023" returned: 0 in 0.291s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:54:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bacf6675-beeb-4c93-b11a-7d46465ed4a0 tempest-CinderUnicodeTest-1953161923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.895s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db2771c-aff6-451a-a857-a807e5d886fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95b8cdf-37dc-4af4-a547-917ab639c34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-bacf6675-beeb-4c93-b11a-7d46465ed4a0 tempest-CinderUnicodeTest-1953161923 None] Creating offline snapshot 8053d742-ffc4-44a5-951a-cba8a7e5576c of volume ce338b85-794e-47cf-adff-a26a251f9af7 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:54:18 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Volume volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023 (7e849dc4-c65b-4df6-b5cb-db4f0c468023): created successfully Sep 23 12:54:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95b8cdf-37dc-4af4-a547-917ab639c34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Flow 'volume_create_manager' (d20376b9-f31a-4e39-a78b-16898e49c069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:18 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5464e9-ed9e-49fb-b48e-cfa66f289ca1]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bacf6675-beeb-4c93-b11a-7d46465ed4a0 tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:18 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-fda8f832-c164-471c-94ed-31c9fd7e6c12 tempest-ProjectMemberTests-1374908563 None] Created volume successfully. Sep 23 12:54:18 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7 Sep 23 12:54:18 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] Acquiring lock "cinder-fcc234cd-eac7-42c6-b09b-e5b00350ab52-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] Lock "cinder-fcc234cd-eac7-42c6-b09b-e5b00350ab52-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] Acquiring lock "cinder-quobyte-fcc234cd-eac7-42c6-b09b-e5b00350ab52" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] Lock "cinder-quobyte-fcc234cd-eac7-42c6-b09b-e5b00350ab52" acquired by "delete_volume" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:18 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[176946c9-5129-4647-9802-66058002a9a0]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcc234cd-eac7-42c6-b09b-e5b00350ab52 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:18 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcc234cd-eac7-42c6-b09b-e5b00350ab52 Sep 23 12:54:18 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:18 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bacf6675-beeb-4c93-b11a-7d46465ed4a0 tempest-CinderUnicodeTest-1953161923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7" returned: 0 in 0.473s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bacf6675-beeb-4c93-b11a-7d46465ed4a0 tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:18 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c 1G Sep 23 12:54:18 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:19 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcc234cd-eac7-42c6-b09b-e5b00350ab52" returned: 0 in 0.406s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcc234cd-eac7-42c6-b09b-e5b00350ab52 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:19 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcc234cd-eac7-42c6-b09b-e5b00350ab52 Sep 23 12:54:19 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:19 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-fcc234cd-eac7-42c6-b09b-e5b00350ab52" returned: 0 in 0.288s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] Lock "cinder-quobyte-fcc234cd-eac7-42c6-b09b-e5b00350ab52" released by "delete_volume" :: held 0.751s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:19 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bacf6675-beeb-4c93-b11a-7d46465ed4a0 tempest-CinderUnicodeTest-1953161923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c 1G" returned: 0 in 0.538s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bacf6675-beeb-4c93-b11a-7d46465ed4a0 tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce338b85-794e-47cf-adff-a26a251f9af7 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:19 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce338b85-794e-47cf-adff-a26a251f9af7 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c Sep 23 12:54:19 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:19 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] Created reservations ['188fe432-3029-4754-a0e2-9148487f7008', 'bd4964e4-47f3-4b5c-8afc-adf806954038', '97e00974-1597-4eb7-8110-a441234b4176', '58abf590-03d0-45f1-aac0-1af603089351'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:19 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:19 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ac7d1aa6-26ad-49e1-863d-e982fce59805 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:19 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bacf6675-beeb-4c93-b11a-7d46465ed4a0 tempest-CinderUnicodeTest-1953161923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce338b85-794e-47cf-adff-a26a251f9af7 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c" returned: 0 in 0.484s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:19 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-bacf6675-beeb-4c93-b11a-7d46465ed4a0 tempest-CinderUnicodeTest-1953161923 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c is being set with open permissions: ugo+rw Sep 23 12:54:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bacf6675-beeb-4c93-b11a-7d46465ed4a0 tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:19 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c Sep 23 12:54:19 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:19 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.378s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:19 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:19 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] Deleted volume successfully. Sep 23 12:54:19 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-cf47c320-01ec-4ac2-b4a2-e33cee9cfd8a tempest-ProjectReaderTests-580709737 None] Lock "cinder-fcc234cd-eac7-42c6-b09b-e5b00350ab52-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:20 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bacf6675-beeb-4c93-b11a-7d46465ed4a0 tempest-CinderUnicodeTest-1953161923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c" returned: 0 in 0.324s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bacf6675-beeb-4c93-b11a-7d46465ed4a0 tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:20 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.info Sep 23 12:54:20 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Flow 'volume_create_manager' (11114b33-404b-4185-b622-8aa63343d294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de15ec99-23a2-4f44-b160-bbe011b7d1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de15ec99-23a2-4f44-b160-bbe011b7d1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486286867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7f5715-7bb9-47ce-ab71-bb1e125d9612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be34d4d9fe1464eaa3fe29cc43d4e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:20Z,use_quota=True,user_id='589bfc53d34445438684bc84c3696377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528a6d9d-7625-4c37-baad-2184fcaed8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528a6d9d-7625-4c37-baad-2184fcaed8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a35804-48a0-4ebd-92ba-97bb4756c84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a35804-48a0-4ebd-92ba-97bb4756c84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f7f5715-7bb9-47ce-ab71-bb1e125d9612', 'volume_name': 'volume-1f7f5715-7bb9-47ce-ab71-bb1e125d9612', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66320a68-7983-436f-812e-a580cc984453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66320a68-7983-436f-812e-a580cc984453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21c08a8-bf46-46e5-8a4e-58aac0687665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:20 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Volume 1f7f5715-7bb9-47ce-ab71-bb1e125d9612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f7f5715-7bb9-47ce-ab71-bb1e125d9612', 'volume_size': 1} Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:20 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bacf6675-beeb-4c93-b11a-7d46465ed4a0 tempest-CinderUnicodeTest-1953161923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.info" returned: 0 in 0.280s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:20 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-bacf6675-beeb-4c93-b11a-7d46465ed4a0 tempest-CinderUnicodeTest-1953161923 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.info is being set with open permissions: ugo+rw Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bacf6675-beeb-4c93-b11a-7d46465ed4a0 tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:20 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.info Sep 23 12:54:20 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:20 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bacf6675-beeb-4c93-b11a-7d46465ed4a0 tempest-CinderUnicodeTest-1953161923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.info" returned: 0 in 0.245s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bacf6675-beeb-4c93-b11a-7d46465ed4a0 tempest-CinderUnicodeTest-1953161923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.481s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ac7d1aa6-26ad-49e1-863d-e982fce59805 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.930s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ac7d1aa6-26ad-49e1-863d-e982fce59805 tempest-ProjectMemberTests-1374908563 None] Creating offline snapshot c58ac8c1-a625-4afe-bdbd-f429553ed244 of volume 7e849dc4-c65b-4df6-b5cb-db4f0c468023 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:54:20 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-bacf6675-beeb-4c93-b11a-7d46465ed4a0 tempest-CinderUnicodeTest-1953161923 None] Create snapshot completed successfully Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c06f000-5d2a-4568-94e7-1ac8f5c4650a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac7d1aa6-26ad-49e1-863d-e982fce59805 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:20 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023 Sep 23 12:54:20 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:21 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac7d1aa6-26ad-49e1-863d-e982fce59805 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023" returned: 0 in 0.384s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac7d1aa6-26ad-49e1-863d-e982fce59805 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:21 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244 1G Sep 23 12:54:21 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] Acquiring lock "cinder-8053d742-ffc4-44a5-951a-cba8a7e5576c-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] Lock "cinder-8053d742-ffc4-44a5-951a-cba8a7e5576c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] Acquiring lock "cinder-quobyte-ce338b85-794e-47cf-adff-a26a251f9af7" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Flow 'volume_create_manager' (699d0ed7-cce8-4726-b148-99d26082e592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e14eff-f4b3-4c8b-b308-40d80f0a4826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] Lock "cinder-quobyte-ce338b85-794e-47cf-adff-a26a251f9af7" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] Acquiring lock "cinder-quobyte-8053d742-ffc4-44a5-951a-cba8a7e5576c" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e14eff-f4b3-4c8b-b308-40d80f0a4826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1765854490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82816717-f553-443b-a2ea-0bb5cd000832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee4f1f0988249b2850ee72b9fbc8d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:21Z,use_quota=True,user_id='e0d279fe88cb4faabec257031d9aeda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d45ff05-9259-4bba-a4c7-6001d4be16fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d45ff05-9259-4bba-a4c7-6001d4be16fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaea4099-6fb0-45b4-b2f7-8fed99ef3583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaea4099-6fb0-45b4-b2f7-8fed99ef3583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82816717-f553-443b-a2ea-0bb5cd000832', 'volume_name': 'volume-82816717-f553-443b-a2ea-0bb5cd000832', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875128cd-6146-46de-8543-99f86cadc48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875128cd-6146-46de-8543-99f86cadc48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775aab80-6212-40af-a86a-6d2f34f48d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:21 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Volume 82816717-f553-443b-a2ea-0bb5cd000832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82816717-f553-443b-a2ea-0bb5cd000832', 'volume_size': 1} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] Lock "cinder-quobyte-8053d742-ffc4-44a5-951a-cba8a7e5576c" acquired by "_delete_snapshot" :: waited 0.065s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] Deleting offline snapshot 8053d742-ffc4-44a5-951a-cba8a7e5576c of volume ce338b85-794e-47cf-adff-a26a251f9af7 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] snapshot_file for this snap is: volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba9cf86-dfb6-429f-bff7-33a644da0673]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:21 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac7d1aa6-26ad-49e1-863d-e982fce59805 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244 1G" returned: 0 in 0.458s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac7d1aa6-26ad-49e1-863d-e982fce59805 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:21 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244 Sep 23 12:54:21 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:21 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c Sep 23 12:54:21 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:21 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac7d1aa6-26ad-49e1-863d-e982fce59805 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244" returned: 0 in 0.273s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:21 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-ac7d1aa6-26ad-49e1-863d-e982fce59805 tempest-ProjectMemberTests-1374908563 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244 is being set with open permissions: ugo+rw Sep 23 12:54:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac7d1aa6-26ad-49e1-863d-e982fce59805 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:21 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244 Sep 23 12:54:21 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:22 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c" returned: 0 in 0.373s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce338b85-794e-47cf-adff-a26a251f9af7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1f4f72-1853-4280-a625-154b16571dfa]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:22 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7 Sep 23 12:54:22 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:22 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac7d1aa6-26ad-49e1-863d-e982fce59805 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244" returned: 0 in 0.242s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac7d1aa6-26ad-49e1-863d-e982fce59805 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:22 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.info Sep 23 12:54:22 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:22 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7" returned: 0 in 0.391s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:22 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c Sep 23 12:54:22 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:22 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac7d1aa6-26ad-49e1-863d-e982fce59805 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.info" returned: 0 in 0.294s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:22 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-ac7d1aa6-26ad-49e1-863d-e982fce59805 tempest-ProjectMemberTests-1374908563 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.info is being set with open permissions: ugo+rw Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac7d1aa6-26ad-49e1-863d-e982fce59805 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:22 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.info Sep 23 12:54:22 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:22 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c" returned: 0 in 0.333s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:22 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ac7d1aa6-26ad-49e1-863d-e982fce59805 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.info" returned: 0 in 0.264s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:22 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c Sep 23 12:54:22 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ac7d1aa6-26ad-49e1-863d-e982fce59805 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.046s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.412s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486286867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7f5715-7bb9-47ce-ab71-bb1e125d9612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be34d4d9fe1464eaa3fe29cc43d4e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:20Z,use_quota=True,user_id='589bfc53d34445438684bc84c3696377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Creating volume 1f7f5715-7bb9-47ce-ab71-bb1e125d9612 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:54:22 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f7f5715-7bb9-47ce-ab71-bb1e125d9612 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:22 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f7f5715-7bb9-47ce-ab71-bb1e125d9612 1073741824 Sep 23 12:54:22 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:22 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=215,cinder:UPDATE=307,cinder:INSERT=80,cinder:DELETE=30 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:54:22 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ac7d1aa6-26ad-49e1-863d-e982fce59805 tempest-ProjectMemberTests-1374908563 None] Create snapshot completed successfully Sep 23 12:54:23 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7.8053d742-ffc4-44a5-951a-cba8a7e5576c" returned: 0 in 0.263s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] Lock "cinder-quobyte-8053d742-ffc4-44a5-951a-cba8a7e5576c" released by "_delete_snapshot" :: held 1.464s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] Lock "cinder-quobyte-ce338b85-794e-47cf-adff-a26a251f9af7" released by "delete_snapshot" :: held 1.536s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=230,cinder:UPDATE=303,cinder:DELETE=27,cinder:INSERT=79 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] Created reservations ['db9ec79e-0af0-441a-a141-616cc28fa7a5', '260abda6-7437-4d56-9cb9-b0f463b046ad', '9871611b-00c9-482e-9e1f-b8577b3b4e8f', '15d858a7-aeba-4d7f-9828-72feec0408fb'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:23 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] Delete snapshot completed successfully. Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-fd237e33-2ebc-4113-90be-40be7b2f61e2 tempest-CinderUnicodeTest-1953161923 None] Lock "cinder-8053d742-ffc4-44a5-951a-cba8a7e5576c-delete_snapshot" released by "delete_snapshot" :: held 1.725s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:23 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f7f5715-7bb9-47ce-ab71-bb1e125d9612 1073741824" returned: 0 in 0.465s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f7f5715-7bb9-47ce-ab71-bb1e125d9612 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:23 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f7f5715-7bb9-47ce-ab71-bb1e125d9612 Sep 23 12:54:23 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:23 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f7f5715-7bb9-47ce-ab71-bb1e125d9612" returned: 0 in 0.242s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.957s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1765854490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82816717-f553-443b-a2ea-0bb5cd000832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee4f1f0988249b2850ee72b9fbc8d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:21Z,use_quota=True,user_id='e0d279fe88cb4faabec257031d9aeda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Creating volume 82816717-f553-443b-a2ea-0bb5cd000832 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:54:23 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21c08a8-bf46-46e5-8a4e-58aac0687665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f7f5715-7bb9-47ce-ab71-bb1e125d9612', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:23 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832 1073741824 Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab6f64c-8b81-4cc0-ae53-b2d0313275d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:23 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] Acquiring lock "cinder-ce338b85-794e-47cf-adff-a26a251f9af7-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:23 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Volume volume-1f7f5715-7bb9-47ce-ab71-bb1e125d9612 (1f7f5715-7bb9-47ce-ab71-bb1e125d9612): created successfully Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab6f64c-8b81-4cc0-ae53-b2d0313275d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Flow 'volume_create_manager' (11114b33-404b-4185-b622-8aa63343d294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] Lock "cinder-ce338b85-794e-47cf-adff-a26a251f9af7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:23 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-24749cb4-6174-44aa-95fd-40ce89faa9d6 tempest-ProjectReaderTests-580709737 None] Created volume successfully. Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] Acquiring lock "cinder-quobyte-ce338b85-794e-47cf-adff-a26a251f9af7" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] Lock "cinder-quobyte-ce338b85-794e-47cf-adff-a26a251f9af7" acquired by "delete_volume" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c300453-4156-4ac3-a69a-96999ee3a2e7]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:23 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7 Sep 23 12:54:23 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-c58ac8c1-a625-4afe-bdbd-f429553ed244-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-c58ac8c1-a625-4afe-bdbd-f429553ed244-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-7e849dc4-c65b-4df6-b5cb-db4f0c468023" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-7e849dc4-c65b-4df6-b5cb-db4f0c468023" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-c58ac8c1-a625-4afe-bdbd-f429553ed244" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-c58ac8c1-a625-4afe-bdbd-f429553ed244" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] Deleting offline snapshot c58ac8c1-a625-4afe-bdbd-f429553ed244 of volume 7e849dc4-c65b-4df6-b5cb-db4f0c468023 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] snapshot_file for this snap is: volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9942740-a679-42ae-9d18-bb32b10d3d5d]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:24 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832 1073741824" returned: 0 in 0.534s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:24 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7" returned: 0 in 0.413s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:24 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832 Sep 23 12:54:24 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:24 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7 Sep 23 12:54:24 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:24 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244 Sep 23 12:54:24 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:24 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832" returned: 0 in 0.254s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775aab80-6212-40af-a86a-6d2f34f48d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82816717-f553-443b-a2ea-0bb5cd000832', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9eb198-f9a4-4620-83cc-ea7ddcfa943f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:24 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ce338b85-794e-47cf-adff-a26a251f9af7" returned: 0 in 0.279s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:24 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Volume volume-82816717-f553-443b-a2ea-0bb5cd000832 (82816717-f553-443b-a2ea-0bb5cd000832): created successfully Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9eb198-f9a4-4620-83cc-ea7ddcfa943f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:24 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Flow 'volume_create_manager' (699d0ed7-cce8-4726-b148-99d26082e592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] Lock "cinder-quobyte-ce338b85-794e-47cf-adff-a26a251f9af7" released by "delete_volume" :: held 0.771s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244" returned: 0 in 0.407s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:54:24 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-175e3e7e-81bc-4954-988f-91f95cd8b559 tempest-ProjectReaderTests-114244591 None] Created volume successfully. Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3d6bcb-7f7d-4966-8bd6-97d7f48c175e]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] Acquiring lock "cinder-1f7f5715-7bb9-47ce-ab71-bb1e125d9612-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] Created reservations ['fcd591fc-6554-4c0f-8275-cf504ededc5b', '74846d27-396a-444a-a737-b55c7f1dcbdc', '7d0e3d1e-e2fa-4ed3-9a48-63d34761319c', '502353e1-c5dd-42ab-8b60-74900d902389'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] Lock "cinder-1f7f5715-7bb9-47ce-ab71-bb1e125d9612-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:24 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023 Sep 23 12:54:24 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] Acquiring lock "cinder-quobyte-1f7f5715-7bb9-47ce-ab71-bb1e125d9612" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] Lock "cinder-quobyte-1f7f5715-7bb9-47ce-ab71-bb1e125d9612" acquired by "delete_volume" :: waited 0.039s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d6c531-6136-43a2-9778-7c44dea6cab4]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f7f5715-7bb9-47ce-ab71-bb1e125d9612 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] Acquiring lock "cinder-dce24f56-c2a9-4f83-8013-8869f1a43a3c-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:24 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:24 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] Lock "cinder-dce24f56-c2a9-4f83-8013-8869f1a43a3c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:24 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f7f5715-7bb9-47ce-ab71-bb1e125d9612 Sep 23 12:54:24 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] Acquiring lock "cinder-quobyte-dce24f56-c2a9-4f83-8013-8869f1a43a3c" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] Lock "cinder-quobyte-dce24f56-c2a9-4f83-8013-8869f1a43a3c" acquired by "delete_volume" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:25 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023" returned: 0 in 0.507s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c95eff4c-754b-45c3-8dbe-c543a28a4645 tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c95eff4c-754b-45c3-8dbe-c543a28a4645 tempest-ProjectReaderTests-114244591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:25 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244 Sep 23 12:54:25 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c670ab-bc45-45e9-b2c5-33cb3bdb0bf1]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dce24f56-c2a9-4f83-8013-8869f1a43a3c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c95eff4c-754b-45c3-8dbe-c543a28a4645 tempest-ProjectReaderTests-114244591 None] Creating offline snapshot e21dc7d7-bd78-442a-9d4c-b998bc7ecc91 of volume 82816717-f553-443b-a2ea-0bb5cd000832 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c6a819-fd49-4904-9601-e3411ea0b4a3]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c95eff4c-754b-45c3-8dbe-c543a28a4645 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:25 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.388s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:25 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] Deleted volume successfully. Sep 23 12:54:25 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dce24f56-c2a9-4f83-8013-8869f1a43a3c Sep 23 12:54:25 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-5117299b-6102-4964-b7b4-51aa04f1f60d tempest-CinderUnicodeTest-1953161923 None] Lock "cinder-ce338b85-794e-47cf-adff-a26a251f9af7-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:25 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f7f5715-7bb9-47ce-ab71-bb1e125d9612" returned: 0 in 0.493s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f7f5715-7bb9-47ce-ab71-bb1e125d9612 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:25 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832 Sep 23 12:54:25 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:25 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f7f5715-7bb9-47ce-ab71-bb1e125d9612 Sep 23 12:54:25 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:25 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244" returned: 0 in 0.404s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:25 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244 Sep 23 12:54:25 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:25 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dce24f56-c2a9-4f83-8013-8869f1a43a3c" returned: 0 in 0.477s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dce24f56-c2a9-4f83-8013-8869f1a43a3c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:25 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1f7f5715-7bb9-47ce-ab71-bb1e125d9612" returned: 0 in 0.296s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:25 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dce24f56-c2a9-4f83-8013-8869f1a43a3c Sep 23 12:54:25 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:25 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] Lock "cinder-quobyte-1f7f5715-7bb9-47ce-ab71-bb1e125d9612" released by "delete_volume" :: held 0.866s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c95eff4c-754b-45c3-8dbe-c543a28a4645 tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832" returned: 0 in 0.470s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c95eff4c-754b-45c3-8dbe-c543a28a4645 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:25 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91 1G Sep 23 12:54:25 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] Created reservations ['884a3428-00c7-466c-81ea-ebbe0113c1af', 'd9296517-f77a-4155-b75f-248f9b326584', '8ba7d3e1-8b79-440e-bd76-7e35a2840a0b', '56b9a36e-2d53-4427-9b29-bbeb75061f97'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:25 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023.c58ac8c1-a625-4afe-bdbd-f429553ed244" returned: 0 in 0.328s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:25 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:25 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:25 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-c58ac8c1-a625-4afe-bdbd-f429553ed244" released by "_delete_snapshot" :: held 1.836s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-dce24f56-c2a9-4f83-8013-8869f1a43a3c" returned: 0 in 0.303s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-7e849dc4-c65b-4df6-b5cb-db4f0c468023" released by "delete_snapshot" :: held 1.875s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] Lock "cinder-quobyte-dce24f56-c2a9-4f83-8013-8869f1a43a3c" released by "delete_volume" :: held 0.886s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] Created reservations ['3e4d3469-cb76-458e-832f-2f4493843fa0', 'af03e7d3-e305-4797-b6f7-2f0ceddbeea9', 'dbbd873c-8012-40e4-a830-f7c47495ad1c', 'aa98dbe7-4f01-4432-b00f-ce6e7c1a6f2f'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:25 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] Created reservations ['40e3957e-5639-4cc5-8c62-8ffc84e62359', 'fc8ca761-02f1-410e-bf03-2c8dff016be1', '32062356-6271-49df-aa07-6ba56da3a863', 'c2f4c257-5643-45d4-833f-8bd8fd719ae0'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:26 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] Delete snapshot completed successfully. Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ffc69dda-a15f-4e78-ba87-8df78244c272 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-c58ac8c1-a625-4afe-bdbd-f429553ed244-delete_snapshot" released by "delete_snapshot" :: held 2.163s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:26 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:26 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-7e849dc4-c65b-4df6-b5cb-db4f0c468023-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] Lock "cinder-7e849dc4-c65b-4df6-b5cb-db4f0c468023-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:26 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:26 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.475s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c95eff4c-754b-45c3-8dbe-c543a28a4645 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91 1G" returned: 0 in 0.669s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c95eff4c-754b-45c3-8dbe-c543a28a4645 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82816717-f553-443b-a2ea-0bb5cd000832 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:26 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] Deleted volume successfully. Sep 23 12:54:26 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82816717-f553-443b-a2ea-0bb5cd000832 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91 Sep 23 12:54:26 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ff0c89e3-aa5b-4b16-8123-508cb6d39642 tempest-ProjectReaderTests-580709737 None] Lock "cinder-1f7f5715-7bb9-47ce-ab71-bb1e125d9612-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-7e849dc4-c65b-4df6-b5cb-db4f0c468023" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-7e849dc4-c65b-4df6-b5cb-db4f0c468023" acquired by "delete_volume" :: waited 0.024s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:26 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.349s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:26 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] Deleted volume successfully. Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f2a1db-72cb-4a9a-80a0-5139fac5c5af]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-53b342d4-641b-4e24-aad1-0fc2218230bd tempest-CinderUnicodeTest-1953161923 None] Lock "cinder-dce24f56-c2a9-4f83-8013-8869f1a43a3c-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:26 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023 Sep 23 12:54:26 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Flow 'volume_create_manager' (3292f31b-4710-4f4b-abab-844f9f1de703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2ca36f-d201-4c6c-8c63-d6fd0ab0e5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2ca36f-d201-4c6c-8c63-d6fd0ab0e5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1517493997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c6b120-a397-46b6-92df-048d8b424ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be34d4d9fe1464eaa3fe29cc43d4e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:27Z,use_quota=True,user_id='589bfc53d34445438684bc84c3696377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572823ba-e5d2-4514-a1d8-e36a4581aee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572823ba-e5d2-4514-a1d8-e36a4581aee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:26 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5590a968-400a-41f0-85c9-2b790f595ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5590a968-400a-41f0-85c9-2b790f595ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57c6b120-a397-46b6-92df-048d8b424ffa', 'volume_name': 'volume-57c6b120-a397-46b6-92df-048d8b424ffa', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d6cfef-fd00-4c08-94cf-fb315c7a9aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d6cfef-fd00-4c08-94cf-fb315c7a9aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539b16cb-c52f-4a6d-9356-e5214275e60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:26 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Volume 57c6b120-a397-46b6-92df-048d8b424ffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57c6b120-a397-46b6-92df-048d8b424ffa', 'volume_size': 1} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c95eff4c-754b-45c3-8dbe-c543a28a4645 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82816717-f553-443b-a2ea-0bb5cd000832 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91" returned: 0 in 0.448s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:26 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-c95eff4c-754b-45c3-8dbe-c543a28a4645 tempest-ProjectReaderTests-114244591 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91 is being set with open permissions: ugo+rw Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c95eff4c-754b-45c3-8dbe-c543a28a4645 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:26 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91 Sep 23 12:54:26 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:26 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023" returned: 0 in 0.433s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:26 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023 Sep 23 12:54:26 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:26 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c95eff4c-754b-45c3-8dbe-c543a28a4645 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91" returned: 0 in 0.277s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c95eff4c-754b-45c3-8dbe-c543a28a4645 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:27 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.info Sep 23 12:54:27 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:27 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-7e849dc4-c65b-4df6-b5cb-db4f0c468023" returned: 0 in 0.294s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-7e849dc4-c65b-4df6-b5cb-db4f0c468023" released by "delete_volume" :: held 0.847s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] Created reservations ['a4500525-6109-4e0f-884f-312b68408646', '81e3d3a7-7ee6-463b-aa69-5ba8b7d13433', '9428e9a2-6022-4e59-a0c9-80a1da60916f', 'ebafd742-af41-4b5a-8a2c-a204782d4eb4'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:27 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c95eff4c-754b-45c3-8dbe-c543a28a4645 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.info" returned: 0 in 0.302s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:27 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-c95eff4c-754b-45c3-8dbe-c543a28a4645 tempest-ProjectReaderTests-114244591 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.info is being set with open permissions: ugo+rw Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c95eff4c-754b-45c3-8dbe-c543a28a4645 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:27 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.info Sep 23 12:54:27 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:27 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:27 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:27 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c95eff4c-754b-45c3-8dbe-c543a28a4645 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.info" returned: 0 in 0.321s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-c95eff4c-754b-45c3-8dbe-c543a28a4645 tempest-ProjectReaderTests-114244591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.644s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.973s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1517493997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c6b120-a397-46b6-92df-048d8b424ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be34d4d9fe1464eaa3fe29cc43d4e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:27Z,use_quota=True,user_id='589bfc53d34445438684bc84c3696377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Creating volume 57c6b120-a397-46b6-92df-048d8b424ffa {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:54:27 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c6b120-a397-46b6-92df-048d8b424ffa 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:27 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:27 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c6b120-a397-46b6-92df-048d8b424ffa 1073741824 Sep 23 12:54:27 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.350s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:27 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] Deleted volume successfully. Sep 23 12:54:27 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-c95eff4c-754b-45c3-8dbe-c543a28a4645 tempest-ProjectReaderTests-114244591 None] Create snapshot completed successfully Sep 23 12:54:27 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-457b3498-ee54-47ed-8096-3382a9e7c16e tempest-ProjectMemberTests-1374908563 None] Lock "cinder-7e849dc4-c65b-4df6-b5cb-db4f0c468023-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Flow 'volume_create_manager' (c8dd9785-d95c-4825-ac6b-4eb2d1ea8819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7546af48-10ab-4d02-9478-50395c756316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7546af48-10ab-4d02-9478-50395c756316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-391807899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef16acec-6264-4332-a72c-002912429751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fdcd86a5cf44b7bf3afc72ccee4603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:28Z,use_quota=True,user_id='399ebb30c0be43a0b1a2458707bca670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c850f1-1a3c-460f-a6dd-81f66e7dc318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c850f1-1a3c-460f-a6dd-81f66e7dc318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92595a58-724b-46c1-9c52-18b6ee273a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92595a58-724b-46c1-9c52-18b6ee273a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef16acec-6264-4332-a72c-002912429751', 'volume_name': 'volume-ef16acec-6264-4332-a72c-002912429751', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695a4ec9-3de8-4df4-89d8-193166d92a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695a4ec9-3de8-4df4-89d8-193166d92a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d272a11-5164-4cda-9d98-76f85817a375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:28 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Volume ef16acec-6264-4332-a72c-002912429751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef16acec-6264-4332-a72c-002912429751', 'volume_size': 1} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:28 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c6b120-a397-46b6-92df-048d8b424ffa 1073741824" returned: 0 in 0.593s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c6b120-a397-46b6-92df-048d8b424ffa {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:28 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c6b120-a397-46b6-92df-048d8b424ffa Sep 23 12:54:28 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-e21dc7d7-bd78-442a-9d4c-b998bc7ecc91-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] Lock "cinder-e21dc7d7-bd78-442a-9d4c-b998bc7ecc91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-quobyte-82816717-f553-443b-a2ea-0bb5cd000832" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-82816717-f553-443b-a2ea-0bb5cd000832" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-quobyte-e21dc7d7-bd78-442a-9d4c-b998bc7ecc91" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-e21dc7d7-bd78-442a-9d4c-b998bc7ecc91" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] Deleting offline snapshot e21dc7d7-bd78-442a-9d4c-b998bc7ecc91 of volume 82816717-f553-443b-a2ea-0bb5cd000832 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] snapshot_file for this snap is: volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7536d4-455e-4cb8-b4e6-9386c35dce0c]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:28 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c6b120-a397-46b6-92df-048d8b424ffa" returned: 0 in 0.295s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-391807899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef16acec-6264-4332-a72c-002912429751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fdcd86a5cf44b7bf3afc72ccee4603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:28Z,use_quota=True,user_id='399ebb30c0be43a0b1a2458707bca670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Creating volume ef16acec-6264-4332-a72c-002912429751 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:54:28 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:28 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751 1073741824 Sep 23 12:54:28 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539b16cb-c52f-4a6d-9356-e5214275e60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c6b120-a397-46b6-92df-048d8b424ffa', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e24057-63c2-45f3-946d-0dd91f68ff55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:28 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Volume volume-57c6b120-a397-46b6-92df-048d8b424ffa (57c6b120-a397-46b6-92df-048d8b424ffa): created successfully Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e24057-63c2-45f3-946d-0dd91f68ff55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:28 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Flow 'volume_create_manager' (3292f31b-4710-4f4b-abab-844f9f1de703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:28 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91 Sep 23 12:54:28 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:28 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-bcb00df6-5da3-403a-bd48-90ad8464d882 tempest-ProjectReaderTests-580709737 None] Created volume successfully. Sep 23 12:54:29 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91" returned: 0 in 0.428s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82816717-f553-443b-a2ea-0bb5cd000832(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1352bc10-6ae6-43c4-827c-21ac65f2e4b3]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:29 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751 1073741824" returned: 0 in 0.481s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:29 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832 Sep 23 12:54:29 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:29 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751 Sep 23 12:54:29 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:29 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:29 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751" returned: 0 in 0.275s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832" returned: 0 in 0.423s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d272a11-5164-4cda-9d98-76f85817a375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef16acec-6264-4332-a72c-002912429751', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:29 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91 Sep 23 12:54:29 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c467f7-c31a-4ea9-b8b2-2b67ec892066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:29 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Volume volume-ef16acec-6264-4332-a72c-002912429751 (ef16acec-6264-4332-a72c-002912429751): created successfully Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c467f7-c31a-4ea9-b8b2-2b67ec892066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Flow 'volume_create_manager' (c8dd9785-d95c-4825-ac6b-4eb2d1ea8819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:29 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-676daa24-4e4b-4bf3-ba5e-707368a1ee55 tempest-ProjectMemberTests-1374908563 None] Created volume successfully. Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] Acquiring lock "cinder-57c6b120-a397-46b6-92df-048d8b424ffa-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] Lock "cinder-57c6b120-a397-46b6-92df-048d8b424ffa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] Acquiring lock "cinder-quobyte-57c6b120-a397-46b6-92df-048d8b424ffa" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] Lock "cinder-quobyte-57c6b120-a397-46b6-92df-048d8b424ffa" acquired by "delete_volume" :: waited 0.023s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7f2ca4-b357-467c-9f5a-c1ce04284dd2]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c6b120-a397-46b6-92df-048d8b424ffa {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:29 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91" returned: 0 in 0.441s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:29 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91 Sep 23 12:54:29 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:30 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c6b120-a397-46b6-92df-048d8b424ffa Sep 23 12:54:30 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:30 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832.e21dc7d7-bd78-442a-9d4c-b998bc7ecc91" returned: 0 in 0.368s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1ec630c2-9512-484e-b459-1a2773d6f0ac tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1ec630c2-9512-484e-b459-1a2773d6f0ac tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-e21dc7d7-bd78-442a-9d4c-b998bc7ecc91" released by "_delete_snapshot" :: held 1.802s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-1ec630c2-9512-484e-b459-1a2773d6f0ac tempest-ProjectMemberTests-1374908563 None] Creating offline snapshot 105588ce-0616-4c20-a9f1-cd30f1a95362 of volume ef16acec-6264-4332-a72c-002912429751 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:54:30 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-82816717-f553-443b-a2ea-0bb5cd000832" released by "delete_snapshot" :: held 1.843s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c6b120-a397-46b6-92df-048d8b424ffa" returned: 0 in 0.457s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c6b120-a397-46b6-92df-048d8b424ffa {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b6aa1d-4da0-4a74-a68a-225c28dec234]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1ec630c2-9512-484e-b459-1a2773d6f0ac tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:30 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c6b120-a397-46b6-92df-048d8b424ffa Sep 23 12:54:30 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] Created reservations ['ac60d13f-e14d-4ae2-9a56-ca40b716e5a1', '80407cf0-622d-4023-a27a-be59e080566f', '6c5f40a5-62b3-4be0-955d-8fbc029e0ae9', '6e954c5e-4dca-4739-9f55-667356b27152'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:30 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751 Sep 23 12:54:30 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:30 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] Delete snapshot completed successfully. Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-d5cd87d0-48e9-4332-85c0-75e75f508536 tempest-ProjectReaderTests-114244591 None] Lock "cinder-e21dc7d7-bd78-442a-9d4c-b998bc7ecc91-delete_snapshot" released by "delete_snapshot" :: held 2.054s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-82816717-f553-443b-a2ea-0bb5cd000832-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] Lock "cinder-82816717-f553-443b-a2ea-0bb5cd000832-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:30 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-57c6b120-a397-46b6-92df-048d8b424ffa" returned: 0 in 0.356s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] Lock "cinder-quobyte-57c6b120-a397-46b6-92df-048d8b424ffa" released by "delete_volume" :: held 0.868s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-quobyte-82816717-f553-443b-a2ea-0bb5cd000832" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-82816717-f553-443b-a2ea-0bb5cd000832" acquired by "delete_volume" :: waited 0.023s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:30 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1ec630c2-9512-484e-b459-1a2773d6f0ac tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751" returned: 0 in 0.440s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1ec630c2-9512-484e-b459-1a2773d6f0ac tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e041def1-2832-48aa-9fff-e9d87cf63ad5]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:30 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362 1G Sep 23 12:54:30 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:30 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] Created reservations ['9f2ef074-fd7b-444c-9341-6fd0b9ab89e0', '0e35e280-32af-4759-aa92-78b8476711a0', '3624726e-0bad-42ed-aa1b-65879c6d8d64', 'a950c767-639e-4a0d-be27-d018c63afc10'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:31 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832 Sep 23 12:54:31 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:31 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:31 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:31 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.286s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:31 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] Deleted volume successfully. Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a0155720-4af6-40d1-9ba3-f7c6ab29bb58 tempest-ProjectReaderTests-580709737 None] Lock "cinder-57c6b120-a397-46b6-92df-048d8b424ffa-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:31 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1ec630c2-9512-484e-b459-1a2773d6f0ac tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362 1G" returned: 0 in 0.540s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1ec630c2-9512-484e-b459-1a2773d6f0ac tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef16acec-6264-4332-a72c-002912429751 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:31 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832" returned: 0 in 0.531s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:31 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef16acec-6264-4332-a72c-002912429751 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362 Sep 23 12:54:31 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:31 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832 Sep 23 12:54:31 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:31 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-82816717-f553-443b-a2ea-0bb5cd000832" returned: 0 in 0.282s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:31 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1ec630c2-9512-484e-b459-1a2773d6f0ac tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef16acec-6264-4332-a72c-002912429751 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362" returned: 0 in 0.314s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:31 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-1ec630c2-9512-484e-b459-1a2773d6f0ac tempest-ProjectMemberTests-1374908563 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362 is being set with open permissions: ugo+rw Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1ec630c2-9512-484e-b459-1a2773d6f0ac tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-82816717-f553-443b-a2ea-0bb5cd000832" released by "delete_volume" :: held 0.911s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:31 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362 Sep 23 12:54:31 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] Created reservations ['f1097150-c5fb-46cd-a670-7b48469c1d4c', '4661db36-52c3-4723-bb5f-79b953855f86', 'e1aaf4df-c66c-44e2-acb9-7b6ee6fe73ee', '44aeccf4-f0df-41b1-ba0f-53db8aad6aec'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:31 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:31 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:31 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1ec630c2-9512-484e-b459-1a2773d6f0ac tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362" returned: 0 in 0.303s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1ec630c2-9512-484e-b459-1a2773d6f0ac tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:32 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.info Sep 23 12:54:32 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:32 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.309s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:32 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:32 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] Deleted volume successfully. Sep 23 12:54:32 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a10b4644-700a-44bd-8c3b-91882394f75e tempest-ProjectReaderTests-114244591 None] Lock "cinder-82816717-f553-443b-a2ea-0bb5cd000832-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:32 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1ec630c2-9512-484e-b459-1a2773d6f0ac tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.info" returned: 0 in 0.402s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:32 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-1ec630c2-9512-484e-b459-1a2773d6f0ac tempest-ProjectMemberTests-1374908563 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.info is being set with open permissions: ugo+rw Sep 23 12:54:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1ec630c2-9512-484e-b459-1a2773d6f0ac tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:32 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.info Sep 23 12:54:32 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:32 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1ec630c2-9512-484e-b459-1a2773d6f0ac tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.info" returned: 0 in 0.287s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1ec630c2-9512-484e-b459-1a2773d6f0ac tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.414s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:32 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-1ec630c2-9512-484e-b459-1a2773d6f0ac tempest-ProjectMemberTests-1374908563 None] Create snapshot completed successfully Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-105588ce-0616-4c20-a9f1-cd30f1a95362-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-105588ce-0616-4c20-a9f1-cd30f1a95362-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-ef16acec-6264-4332-a72c-002912429751" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-ef16acec-6264-4332-a72c-002912429751" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-105588ce-0616-4c20-a9f1-cd30f1a95362" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Flow 'volume_create_manager' (48e25f00-229f-40cc-8bb7-13acfacad191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b505fa23-2cb4-4981-8e95-73b695bbb6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-105588ce-0616-4c20-a9f1-cd30f1a95362" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] Deleting offline snapshot 105588ce-0616-4c20-a9f1-cd30f1a95362 of volume ef16acec-6264-4332-a72c-002912429751 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] snapshot_file for this snap is: volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b505fa23-2cb4-4981-8e95-73b695bbb6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450409525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3dbb89-fe51-4290-b07c-965770c2eff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee4f1f0988249b2850ee72b9fbc8d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:34Z,use_quota=True,user_id='e0d279fe88cb4faabec257031d9aeda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbd3293-d155-4a36-a9a4-5a12b1dfe2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbd3293-d155-4a36-a9a4-5a12b1dfe2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5075269b-ae17-4b46-816b-0d6854bca750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5075269b-ae17-4b46-816b-0d6854bca750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d3dbb89-fe51-4290-b07c-965770c2eff9', 'volume_name': 'volume-0d3dbb89-fe51-4290-b07c-965770c2eff9', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe2164b-def6-4eb2-9b85-0c25b866f1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe2164b-def6-4eb2-9b85-0c25b866f1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7c90ab-0612-4963-95ca-efd09b068a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:33 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Volume 0d3dbb89-fe51-4290-b07c-965770c2eff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d3dbb89-fe51-4290-b07c-965770c2eff9', 'volume_size': 1} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450409525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3dbb89-fe51-4290-b07c-965770c2eff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee4f1f0988249b2850ee72b9fbc8d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:34Z,use_quota=True,user_id='e0d279fe88cb4faabec257031d9aeda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Creating volume 0d3dbb89-fe51-4290-b07c-965770c2eff9 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:54:33 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b3c7bc-6c9a-46eb-a9f6-0b730e7ff137]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:33 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9 1073741824 Sep 23 12:54:33 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:33 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362 Sep 23 12:54:33 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:34 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362" returned: 0 in 0.503s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef16acec-6264-4332-a72c-002912429751(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:54:34 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[3494e35d-448c-483c-9fe1-e816e2a1c6bb]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:34 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9 1073741824" returned: 0 in 0.570s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:34 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9 Sep 23 12:54:34 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:34 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751 Sep 23 12:54:34 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:34 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9" returned: 0 in 0.271s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:54:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7c90ab-0612-4963-95ca-efd09b068a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d3dbb89-fe51-4290-b07c-965770c2eff9', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b9a33a-e07d-4ca2-8f8b-c9b016d4b5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:34 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Volume volume-0d3dbb89-fe51-4290-b07c-965770c2eff9 (0d3dbb89-fe51-4290-b07c-965770c2eff9): created successfully Sep 23 12:54:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b9a33a-e07d-4ca2-8f8b-c9b016d4b5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:34 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Flow 'volume_create_manager' (48e25f00-229f-40cc-8bb7-13acfacad191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:34 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-1833839d-45a6-4e47-9896-96be3bc836d4 tempest-ProjectReaderTests-114244591 None] Created volume successfully. Sep 23 12:54:34 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751" returned: 0 in 0.416s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:34 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362 Sep 23 12:54:34 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:35 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362" returned: 0 in 0.368s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:35 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362 Sep 23 12:54:35 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:35 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751.105588ce-0616-4c20-a9f1-cd30f1a95362" returned: 0 in 0.249s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-105588ce-0616-4c20-a9f1-cd30f1a95362" released by "_delete_snapshot" :: held 1.760s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-ef16acec-6264-4332-a72c-002912429751" released by "delete_snapshot" :: held 1.826s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:35 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] Created reservations ['a0eb6234-ab8e-4fde-8bd5-5d0a591eaf96', '97018cc8-9dad-49cb-bf70-25edc64b08de', 'c8af6d0b-3d4e-46e6-bfa3-7eb3d32a43ce', '55de5757-d3eb-4894-a82b-5c8cffa30615'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:35 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] Delete snapshot completed successfully. Sep 23 12:54:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-55db5630-bbc2-47fb-95c8-97c3fa92d8a4 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-105588ce-0616-4c20-a9f1-cd30f1a95362-delete_snapshot" released by "delete_snapshot" :: held 1.981s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-ef16acec-6264-4332-a72c-002912429751-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] Lock "cinder-ef16acec-6264-4332-a72c-002912429751-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-ef16acec-6264-4332-a72c-002912429751" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-cd25f29b-c72f-453c-a61a-383597b0fc12 tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-cd25f29b-c72f-453c-a61a-383597b0fc12 tempest-ProjectReaderTests-114244591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-ef16acec-6264-4332-a72c-002912429751" acquired by "delete_volume" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:35 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-cd25f29b-c72f-453c-a61a-383597b0fc12 tempest-ProjectReaderTests-114244591 None] Creating offline snapshot dba888a1-3fef-464c-9b41-516376e412cd of volume 0d3dbb89-fe51-4290-b07c-965770c2eff9 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:54:35 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d40619e-8f74-41d7-a38e-ee08c04b6e17]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:35 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cf0bbf-d501-484a-92f2-3b7584bd247f]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cd25f29b-c72f-453c-a61a-383597b0fc12 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:35 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751 Sep 23 12:54:35 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:36 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9 Sep 23 12:54:36 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:36 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:36 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751" returned: 0 in 0.395s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cd25f29b-c72f-453c-a61a-383597b0fc12 tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9" returned: 0 in 0.392s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cd25f29b-c72f-453c-a61a-383597b0fc12 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:36 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751 Sep 23 12:54:36 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:36 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd 1G Sep 23 12:54:36 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:36 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-ef16acec-6264-4332-a72c-002912429751" returned: 0 in 0.258s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:36 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-ef16acec-6264-4332-a72c-002912429751" released by "delete_volume" :: held 0.724s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:36 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] Created reservations ['532bc7e6-d6a6-4c1b-ad2c-411937e7dc67', '308d3265-cb4a-4547-b927-913ee3c3c1c4', 'cc8d03f7-1e45-41aa-aadb-dfe76ca74ee4', '42c44ada-3b10-41c5-8d43-6c8dc2534165'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:36 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:36 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:36 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:36 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cd25f29b-c72f-453c-a61a-383597b0fc12 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd 1G" returned: 0 in 0.541s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:36 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cd25f29b-c72f-453c-a61a-383597b0fc12 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3dbb89-fe51-4290-b07c-965770c2eff9 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:36 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3dbb89-fe51-4290-b07c-965770c2eff9 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd Sep 23 12:54:36 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:37 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.288s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:37 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] Deleted volume successfully. Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-8ff6f0b2-1b9b-45b8-a94a-02f622ca4b3d tempest-ProjectMemberTests-1374908563 None] Lock "cinder-ef16acec-6264-4332-a72c-002912429751-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:37 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cd25f29b-c72f-453c-a61a-383597b0fc12 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3dbb89-fe51-4290-b07c-965770c2eff9 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd" returned: 0 in 0.395s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:37 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-cd25f29b-c72f-453c-a61a-383597b0fc12 tempest-ProjectReaderTests-114244591 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd is being set with open permissions: ugo+rw Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cd25f29b-c72f-453c-a61a-383597b0fc12 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:37 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd Sep 23 12:54:37 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Flow 'volume_create_manager' (5ac94197-8317-48af-8827-ed5a1e66b6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:37 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4538b3-9652-4d0b-9f43-fb74d3ec1fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cd25f29b-c72f-453c-a61a-383597b0fc12 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd" returned: 0 in 0.271s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4538b3-9652-4d0b-9f43-fb74d3ec1fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-89136139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea66489-7b82-4ab7-ade7-fcab7067d205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fdcd86a5cf44b7bf3afc72ccee4603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:37Z,use_quota=True,user_id='399ebb30c0be43a0b1a2458707bca670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5fed65-7453-44fa-abad-eb8e55708074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5fed65-7453-44fa-abad-eb8e55708074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea25ece-1adb-4000-9eea-eceff5264cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea25ece-1adb-4000-9eea-eceff5264cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ea66489-7b82-4ab7-ade7-fcab7067d205', 'volume_name': 'volume-8ea66489-7b82-4ab7-ade7-fcab7067d205', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabef3a1-a4b8-4207-bf24-51aae41cd585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabef3a1-a4b8-4207-bf24-51aae41cd585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bcbd6f-bded-40da-b219-cfb529dd6faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:37 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Volume 8ea66489-7b82-4ab7-ade7-fcab7067d205: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ea66489-7b82-4ab7-ade7-fcab7067d205', 'volume_size': 1} Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cd25f29b-c72f-453c-a61a-383597b0fc12 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:37 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.info Sep 23 12:54:37 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:37 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cd25f29b-c72f-453c-a61a-383597b0fc12 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.info" returned: 0 in 0.245s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:37 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-cd25f29b-c72f-453c-a61a-383597b0fc12 tempest-ProjectReaderTests-114244591 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.info is being set with open permissions: ugo+rw Sep 23 12:54:37 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cd25f29b-c72f-453c-a61a-383597b0fc12 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:37 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.info Sep 23 12:54:37 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:38 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cd25f29b-c72f-453c-a61a-383597b0fc12 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.info" returned: 0 in 0.257s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-cd25f29b-c72f-453c-a61a-383597b0fc12 tempest-ProjectReaderTests-114244591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.261s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.546s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-89136139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea66489-7b82-4ab7-ade7-fcab7067d205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fdcd86a5cf44b7bf3afc72ccee4603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:37Z,use_quota=True,user_id='399ebb30c0be43a0b1a2458707bca670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Creating volume 8ea66489-7b82-4ab7-ade7-fcab7067d205 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:54:38 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:38 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205 1073741824 Sep 23 12:54:38 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:38 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-cd25f29b-c72f-453c-a61a-383597b0fc12 tempest-ProjectReaderTests-114244591 None] Create snapshot completed successfully Sep 23 12:54:38 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205 1073741824" returned: 0 in 0.488s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:38 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205 Sep 23 12:54:38 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:38 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205" returned: 0 in 0.267s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bcbd6f-bded-40da-b219-cfb529dd6faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea66489-7b82-4ab7-ade7-fcab7067d205', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ce7e41-3f12-4280-b9b4-8b741a599d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:38 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Volume volume-8ea66489-7b82-4ab7-ade7-fcab7067d205 (8ea66489-7b82-4ab7-ade7-fcab7067d205): created successfully Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ce7e41-3f12-4280-b9b4-8b741a599d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Flow 'volume_create_manager' (5ac94197-8317-48af-8827-ed5a1e66b6e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:39 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-229db7a3-c977-4474-8896-b512bc352197 tempest-ProjectMemberTests-1374908563 None] Created volume successfully. Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-dba888a1-3fef-464c-9b41-516376e412cd-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] Lock "cinder-dba888a1-3fef-464c-9b41-516376e412cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-quobyte-0d3dbb89-fe51-4290-b07c-965770c2eff9" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-0d3dbb89-fe51-4290-b07c-965770c2eff9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-quobyte-dba888a1-3fef-464c-9b41-516376e412cd" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-dba888a1-3fef-464c-9b41-516376e412cd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] Deleting offline snapshot dba888a1-3fef-464c-9b41-516376e412cd of volume 0d3dbb89-fe51-4290-b07c-965770c2eff9 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] snapshot_file for this snap is: volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5afe0f-c202-4144-b362-eaad7240b09d]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:39 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd Sep 23 12:54:39 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:39 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd" returned: 0 in 0.373s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d3dbb89-fe51-4290-b07c-965770c2eff9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[db706dd9-439f-442f-832a-41970104f2e5]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:39 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9 Sep 23 12:54:39 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d6276aa2-6df1-4550-9381-89566581b0b7 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d6276aa2-6df1-4550-9381-89566581b0b7 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d6276aa2-6df1-4550-9381-89566581b0b7 tempest-ProjectMemberTests-1374908563 None] Creating offline snapshot 95c1b14f-da6a-4bb8-abc6-6e285f956b33 of volume 8ea66489-7b82-4ab7-ade7-fcab7067d205 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab90d4bf-bf00-4e29-bc84-d0b736a59015]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6276aa2-6df1-4550-9381-89566581b0b7 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:39 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205 Sep 23 12:54:39 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:39 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9" returned: 0 in 0.393s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:39 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd Sep 23 12:54:39 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:40 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6276aa2-6df1-4550-9381-89566581b0b7 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205" returned: 0 in 0.412s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6276aa2-6df1-4550-9381-89566581b0b7 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:40 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33 1G Sep 23 12:54:40 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:40 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd" returned: 0 in 0.378s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:40 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd Sep 23 12:54:40 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:40 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9.dba888a1-3fef-464c-9b41-516376e412cd" returned: 0 in 0.296s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:40 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6276aa2-6df1-4550-9381-89566581b0b7 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33 1G" returned: 0 in 0.490s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6276aa2-6df1-4550-9381-89566581b0b7 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ea66489-7b82-4ab7-ade7-fcab7067d205 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:40 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-dba888a1-3fef-464c-9b41-516376e412cd" released by "_delete_snapshot" :: held 1.570s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:40 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-0d3dbb89-fe51-4290-b07c-965770c2eff9" released by "delete_snapshot" :: held 1.603s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:40 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ea66489-7b82-4ab7-ade7-fcab7067d205 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33 Sep 23 12:54:40 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:40 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] Created reservations ['89391bf6-6d39-49ef-ac2a-48d75a26d693', '65aab585-98bb-4fb3-81ee-f2d5d34b2e78', '8ae8c7b7-defc-46b6-9d18-92fe8b604e69', '87e0b7b9-15c2-42e1-ba2c-91d26f610fa3'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:40 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] Delete snapshot completed successfully. Sep 23 12:54:40 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-496dd689-0249-43c0-9b58-6d6bcaa2ed02 tempest-ProjectReaderTests-114244591 None] Lock "cinder-dba888a1-3fef-464c-9b41-516376e412cd-delete_snapshot" released by "delete_snapshot" :: held 1.772s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:41 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6276aa2-6df1-4550-9381-89566581b0b7 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ea66489-7b82-4ab7-ade7-fcab7067d205 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33" returned: 0 in 0.340s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:41 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-d6276aa2-6df1-4550-9381-89566581b0b7 tempest-ProjectMemberTests-1374908563 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33 is being set with open permissions: ugo+rw Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6276aa2-6df1-4550-9381-89566581b0b7 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:41 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33 Sep 23 12:54:41 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-0d3dbb89-fe51-4290-b07c-965770c2eff9-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:41 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] Lock "cinder-0d3dbb89-fe51-4290-b07c-965770c2eff9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6276aa2-6df1-4550-9381-89566581b0b7 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33" returned: 0 in 0.278s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6276aa2-6df1-4550-9381-89566581b0b7 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-quobyte-0d3dbb89-fe51-4290-b07c-965770c2eff9" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:41 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.info Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-0d3dbb89-fe51-4290-b07c-965770c2eff9" acquired by "delete_volume" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:41 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[37803a48-3f3e-4bf0-82c5-01ef392432f7]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:41 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:41 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:41 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9 Sep 23 12:54:41 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:41 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6276aa2-6df1-4550-9381-89566581b0b7 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.info" returned: 0 in 0.316s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:41 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-d6276aa2-6df1-4550-9381-89566581b0b7 tempest-ProjectMemberTests-1374908563 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.info is being set with open permissions: ugo+rw Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6276aa2-6df1-4550-9381-89566581b0b7 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:41 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.info Sep 23 12:54:41 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:41 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.327s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:54:41 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9" returned: 0 in 0.433s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:41 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9 Sep 23 12:54:41 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:41 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d6276aa2-6df1-4550-9381-89566581b0b7 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.info" returned: 0 in 0.295s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d6276aa2-6df1-4550-9381-89566581b0b7 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.242s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:42 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d6276aa2-6df1-4550-9381-89566581b0b7 tempest-ProjectMemberTests-1374908563 None] Create snapshot completed successfully Sep 23 12:54:42 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-0d3dbb89-fe51-4290-b07c-965770c2eff9" returned: 0 in 0.289s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-0d3dbb89-fe51-4290-b07c-965770c2eff9" released by "delete_volume" :: held 0.803s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:42 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] Created reservations ['397f24c8-b962-4e0d-8b04-b9db08cf594a', 'e92d9bd1-3571-4601-b51b-e47dc7a0d6d2', '47ca439b-c7c2-49ee-8d8b-c76bd77dd024', '62daae20-a682-4e2d-97e4-9a8ca378e4c6'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:42 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:42 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:42 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:42 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.261s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:42 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:42 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] Deleted volume successfully. Sep 23 12:54:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-00a6a670-3c1d-495a-97b4-9c2dc998a0f7 tempest-ProjectReaderTests-114244591 None] Lock "cinder-0d3dbb89-fe51-4290-b07c-965770c2eff9-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:42 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:54:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Flow 'volume_create_manager' (d4ba94b1-de90-42ab-9753-d599fad26e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f9bed2-7591-4fc6-b457-2b7fd4810e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:42 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-95c1b14f-da6a-4bb8-abc6-6e285f956b33-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:42 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f9bed2-7591-4fc6-b457-2b7fd4810e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1594105052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aee17f9-dc60-48ff-991a-cbd313668752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee4f1f0988249b2850ee72b9fbc8d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:43Z,use_quota=True,user_id='e0d279fe88cb4faabec257031d9aeda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939ab2a8-44d3-4bee-988a-013c3850d531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939ab2a8-44d3-4bee-988a-013c3850d531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3dffc89-708b-429f-9968-7800ade21d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3dffc89-708b-429f-9968-7800ade21d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aee17f9-dc60-48ff-991a-cbd313668752', 'volume_name': 'volume-6aee17f9-dc60-48ff-991a-cbd313668752', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0749b82-32ea-416b-9a92-1b63598c7073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0749b82-32ea-416b-9a92-1b63598c7073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8018b5-3643-43c9-aed7-3ab7cf9ba459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:43 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Volume 6aee17f9-dc60-48ff-991a-cbd313668752: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aee17f9-dc60-48ff-991a-cbd313668752', 'volume_size': 1} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1594105052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aee17f9-dc60-48ff-991a-cbd313668752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee4f1f0988249b2850ee72b9fbc8d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:43Z,use_quota=True,user_id='e0d279fe88cb4faabec257031d9aeda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Creating volume 6aee17f9-dc60-48ff-991a-cbd313668752 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:54:43 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-95c1b14f-da6a-4bb8-abc6-6e285f956b33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.104s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:43 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752 1073741824 Sep 23 12:54:43 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-8ea66489-7b82-4ab7-ade7-fcab7067d205" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-8ea66489-7b82-4ab7-ade7-fcab7067d205" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-95c1b14f-da6a-4bb8-abc6-6e285f956b33" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-95c1b14f-da6a-4bb8-abc6-6e285f956b33" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] Deleting offline snapshot 95c1b14f-da6a-4bb8-abc6-6e285f956b33 of volume 8ea66489-7b82-4ab7-ade7-fcab7067d205 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] snapshot_file for this snap is: volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8c885a-d9d6-4965-a44e-acbf5895410f]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:43 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33 Sep 23 12:54:43 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:43 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33" returned: 0 in 0.393s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ea66489-7b82-4ab7-ade7-fcab7067d205(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3783dd6-d2e4-479e-89e8-e6c12e0d466d]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:43 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752 1073741824" returned: 0 in 0.619s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:43 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205 Sep 23 12:54:43 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:43 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752 Sep 23 12:54:43 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:44 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205" returned: 0 in 0.436s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:44 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752" returned: 0 in 0.352s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:44 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:54:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:44 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33 Sep 23 12:54:44 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:44 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8018b5-3643-43c9-aed7-3ab7cf9ba459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aee17f9-dc60-48ff-991a-cbd313668752', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:44 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a377d1-3694-401d-8d96-593b586fd8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:44 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Volume volume-6aee17f9-dc60-48ff-991a-cbd313668752 (6aee17f9-dc60-48ff-991a-cbd313668752): created successfully Sep 23 12:54:44 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a377d1-3694-401d-8d96-593b586fd8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:44 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Flow 'volume_create_manager' (d4ba94b1-de90-42ab-9753-d599fad26e1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:44 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-5408d7e6-ed22-4dc4-9730-03945f6ddcf9 tempest-ProjectReaderTests-114244591 None] Created volume successfully. Sep 23 12:54:44 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33" returned: 0 in 0.389s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:44 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33 Sep 23 12:54:44 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:44 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205.95c1b14f-da6a-4bb8-abc6-6e285f956b33" returned: 0 in 0.261s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-95c1b14f-da6a-4bb8-abc6-6e285f956b33" released by "_delete_snapshot" :: held 1.596s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-8ea66489-7b82-4ab7-ade7-fcab7067d205" released by "delete_snapshot" :: held 1.632s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:44 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] Created reservations ['82ae4dad-a1c3-46ad-a42c-3d9b2d6385a4', 'c4651e7d-6a22-4477-8cc2-19760a45f5ac', '7f630266-1dab-4046-86fb-43a2a33df06c', '2753e72a-b693-4cb9-bc52-146f92254016'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:44 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] Delete snapshot completed successfully. Sep 23 12:54:44 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-95abfc7c-ef89-43e8-a338-1fd8405efa27 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-95c1b14f-da6a-4bb8-abc6-6e285f956b33-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-765a4bb1-12ab-4285-8122-6f01655b81d8 tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-765a4bb1-12ab-4285-8122-6f01655b81d8 tempest-ProjectReaderTests-114244591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-8ea66489-7b82-4ab7-ade7-fcab7067d205-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:45 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-765a4bb1-12ab-4285-8122-6f01655b81d8 tempest-ProjectReaderTests-114244591 None] Creating offline snapshot 25693437-8903-4cb3-acb5-06cf272265e4 of volume 6aee17f9-dc60-48ff-991a-cbd313668752 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:54:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-8ea66489-7b82-4ab7-ade7-fcab7067d205-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:45 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef514864-3a6f-4137-a2a3-2964eef95f60]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-765a4bb1-12ab-4285-8122-6f01655b81d8 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-8ea66489-7b82-4ab7-ade7-fcab7067d205" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:45 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-8ea66489-7b82-4ab7-ade7-fcab7067d205" acquired by "delete_volume" :: waited 0.014s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:45 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c92da2-0dc6-4cae-a499-1622b440ec40]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:45 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752 Sep 23 12:54:45 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:45 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205 Sep 23 12:54:45 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:45 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-765a4bb1-12ab-4285-8122-6f01655b81d8 tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752" returned: 0 in 0.408s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-765a4bb1-12ab-4285-8122-6f01655b81d8 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:45 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4 1G Sep 23 12:54:45 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:45 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205" returned: 0 in 0.414s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:45 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:45 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205 Sep 23 12:54:45 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:46 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-8ea66489-7b82-4ab7-ade7-fcab7067d205" returned: 0 in 0.284s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-8ea66489-7b82-4ab7-ade7-fcab7067d205" released by "delete_volume" :: held 0.768s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:46 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-765a4bb1-12ab-4285-8122-6f01655b81d8 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4 1G" returned: 0 in 0.443s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-765a4bb1-12ab-4285-8122-6f01655b81d8 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aee17f9-dc60-48ff-991a-cbd313668752 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:46 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aee17f9-dc60-48ff-991a-cbd313668752 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4 Sep 23 12:54:46 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] Created reservations ['762bbdbf-e7ff-4a8d-8266-21f328f53774', 'cdfef059-5912-43e0-9a37-8776ec39de05', '25252d06-1c40-4c4a-8bd4-955371669f8a', '558c5cca-bb1b-43a1-94c3-9cb313ea7a52'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:46 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:46 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:46 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-765a4bb1-12ab-4285-8122-6f01655b81d8 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aee17f9-dc60-48ff-991a-cbd313668752 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4" returned: 0 in 0.378s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:46 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-765a4bb1-12ab-4285-8122-6f01655b81d8 tempest-ProjectReaderTests-114244591 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4 is being set with open permissions: ugo+rw Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-765a4bb1-12ab-4285-8122-6f01655b81d8 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:46 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4 Sep 23 12:54:46 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:46 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.339s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:46 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] Deleted volume successfully. Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-34f00ef7-b0cc-4878-92a9-682ae0f27057 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-8ea66489-7b82-4ab7-ade7-fcab7067d205-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:46 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-765a4bb1-12ab-4285-8122-6f01655b81d8 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4" returned: 0 in 0.316s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-765a4bb1-12ab-4285-8122-6f01655b81d8 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:46 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.info Sep 23 12:54:46 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Flow 'volume_create_manager' (c1e3fb9a-a5d5-4747-bd15-40a07ec8b729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:46 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423dcd43-d135-4238-8ae8-7e15878f8c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423dcd43-d135-4238-8ae8-7e15878f8c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2141778157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83ea129b-b254-4d66-b033-2e0a3377f49f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fdcd86a5cf44b7bf3afc72ccee4603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:47Z,use_quota=True,user_id='399ebb30c0be43a0b1a2458707bca670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac59e8a-7ffe-4578-add5-2864df36673b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac59e8a-7ffe-4578-add5-2864df36673b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ef1939-1907-4ccb-a0b2-1c42d037656e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ef1939-1907-4ccb-a0b2-1c42d037656e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83ea129b-b254-4d66-b033-2e0a3377f49f', 'volume_name': 'volume-83ea129b-b254-4d66-b033-2e0a3377f49f', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a08cd5-f75f-45f9-8a50-019b69cf63c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a08cd5-f75f-45f9-8a50-019b69cf63c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eaebde8-209b-424c-9672-dddc75ea6db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:47 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Volume 83ea129b-b254-4d66-b033-2e0a3377f49f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83ea129b-b254-4d66-b033-2e0a3377f49f', 'volume_size': 1} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:47 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-765a4bb1-12ab-4285-8122-6f01655b81d8 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.info" returned: 0 in 0.280s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:47 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-765a4bb1-12ab-4285-8122-6f01655b81d8 tempest-ProjectReaderTests-114244591 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.info is being set with open permissions: ugo+rw Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-765a4bb1-12ab-4285-8122-6f01655b81d8 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:47 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.info Sep 23 12:54:47 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:47 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-765a4bb1-12ab-4285-8122-6f01655b81d8 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.info" returned: 0 in 0.250s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-765a4bb1-12ab-4285-8122-6f01655b81d8 tempest-ProjectReaderTests-114244591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.318s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2141778157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83ea129b-b254-4d66-b033-2e0a3377f49f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fdcd86a5cf44b7bf3afc72ccee4603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:47Z,use_quota=True,user_id='399ebb30c0be43a0b1a2458707bca670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Creating volume 83ea129b-b254-4d66-b033-2e0a3377f49f {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:54:47 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:47 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f 1073741824 Sep 23 12:54:47 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:47 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-765a4bb1-12ab-4285-8122-6f01655b81d8 tempest-ProjectReaderTests-114244591 None] Create snapshot completed successfully Sep 23 12:54:47 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f 1073741824" returned: 0 in 0.472s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:47 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:47 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f Sep 23 12:54:47 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:48 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f" returned: 0 in 0.245s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eaebde8-209b-424c-9672-dddc75ea6db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83ea129b-b254-4d66-b033-2e0a3377f49f', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d3f449-199a-409a-8e37-e65be1580a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:48 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Volume volume-83ea129b-b254-4d66-b033-2e0a3377f49f (83ea129b-b254-4d66-b033-2e0a3377f49f): created successfully Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d3f449-199a-409a-8e37-e65be1580a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Flow 'volume_create_manager' (c1e3fb9a-a5d5-4747-bd15-40a07ec8b729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:48 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-a9644737-acd5-4455-830a-05d691759763 tempest-ProjectMemberTests-1374908563 None] Created volume successfully. Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-25693437-8903-4cb3-acb5-06cf272265e4-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] Lock "cinder-25693437-8903-4cb3-acb5-06cf272265e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-quobyte-6aee17f9-dc60-48ff-991a-cbd313668752" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-6aee17f9-dc60-48ff-991a-cbd313668752" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-quobyte-25693437-8903-4cb3-acb5-06cf272265e4" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-25693437-8903-4cb3-acb5-06cf272265e4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] Deleting offline snapshot 25693437-8903-4cb3-acb5-06cf272265e4 of volume 6aee17f9-dc60-48ff-991a-cbd313668752 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] snapshot_file for this snap is: volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[de56a347-7ee1-4906-9970-b109e54861a6]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:48 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4 Sep 23 12:54:48 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:48 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4" returned: 0 in 0.374s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6aee17f9-dc60-48ff-991a-cbd313668752(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[564ae529-df84-4313-ab89-1e1ab73cfba9]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:48 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:49 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752 Sep 23 12:54:49 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9116f026-ca77-4b1b-8fea-b117feca2ea9 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9116f026-ca77-4b1b-8fea-b117feca2ea9 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:49 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-9116f026-ca77-4b1b-8fea-b117feca2ea9 tempest-ProjectMemberTests-1374908563 None] Creating offline snapshot c6939231-42d6-48be-8da7-dcac551c81d4 of volume 83ea129b-b254-4d66-b033-2e0a3377f49f {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:54:49 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[425bfb4b-376b-4d40-a677-3d7052f5aa1e]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9116f026-ca77-4b1b-8fea-b117feca2ea9 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:49 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752" returned: 0 in 0.427s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:49 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4 Sep 23 12:54:49 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:49 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f Sep 23 12:54:49 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:49 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9116f026-ca77-4b1b-8fea-b117feca2ea9 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f" returned: 0 in 0.414s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9116f026-ca77-4b1b-8fea-b117feca2ea9 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:49 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4 1G Sep 23 12:54:49 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:49 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4" returned: 0 in 0.434s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:49 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:49 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4 Sep 23 12:54:49 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:50 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752.25693437-8903-4cb3-acb5-06cf272265e4" returned: 0 in 0.276s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-25693437-8903-4cb3-acb5-06cf272265e4" released by "_delete_snapshot" :: held 1.623s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-6aee17f9-dc60-48ff-991a-cbd313668752" released by "delete_snapshot" :: held 1.651s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:50 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9116f026-ca77-4b1b-8fea-b117feca2ea9 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4 1G" returned: 0 in 0.494s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9116f026-ca77-4b1b-8fea-b117feca2ea9 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ea129b-b254-4d66-b033-2e0a3377f49f -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:50 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] Created reservations ['2c112bbd-11ad-4252-bc33-1314332529e1', '47c87cd0-b5b2-46d4-8f10-bea745f8ac3e', 'fbf3a71b-7bc2-4232-afec-232ce98d8c8a', 'cff7833a-c004-438c-9207-08c7b8f905f8'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:50 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ea129b-b254-4d66-b033-2e0a3377f49f -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4 Sep 23 12:54:50 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:50 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] Delete snapshot completed successfully. Sep 23 12:54:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-4e7b7fc9-4553-49dc-9a98-c497d2b7107f tempest-ProjectReaderTests-114244591 None] Lock "cinder-25693437-8903-4cb3-acb5-06cf272265e4-delete_snapshot" released by "delete_snapshot" :: held 1.904s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:50 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9116f026-ca77-4b1b-8fea-b117feca2ea9 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ea129b-b254-4d66-b033-2e0a3377f49f -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4" returned: 0 in 0.329s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:50 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-9116f026-ca77-4b1b-8fea-b117feca2ea9 tempest-ProjectMemberTests-1374908563 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4 is being set with open permissions: ugo+rw Sep 23 12:54:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9116f026-ca77-4b1b-8fea-b117feca2ea9 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:50 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4 Sep 23 12:54:50 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-6aee17f9-dc60-48ff-991a-cbd313668752-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] Lock "cinder-6aee17f9-dc60-48ff-991a-cbd313668752-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-quobyte-6aee17f9-dc60-48ff-991a-cbd313668752" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-6aee17f9-dc60-48ff-991a-cbd313668752" acquired by "delete_volume" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:50 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9116f026-ca77-4b1b-8fea-b117feca2ea9 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4" returned: 0 in 0.294s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:50 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f32164-52df-4ad4-8865-84f22b202029]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9116f026-ca77-4b1b-8fea-b117feca2ea9 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:50 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.info Sep 23 12:54:50 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:50 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752 Sep 23 12:54:50 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:51 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9116f026-ca77-4b1b-8fea-b117feca2ea9 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.info" returned: 0 in 0.271s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:51 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-9116f026-ca77-4b1b-8fea-b117feca2ea9 tempest-ProjectMemberTests-1374908563 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.info is being set with open permissions: ugo+rw Sep 23 12:54:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9116f026-ca77-4b1b-8fea-b117feca2ea9 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:51 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.info Sep 23 12:54:51 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:51 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752" returned: 0 in 0.394s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:51 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752 Sep 23 12:54:51 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:51 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9116f026-ca77-4b1b-8fea-b117feca2ea9 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.info" returned: 0 in 0.273s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9116f026-ca77-4b1b-8fea-b117feca2ea9 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.193s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:51 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-9116f026-ca77-4b1b-8fea-b117feca2ea9 tempest-ProjectMemberTests-1374908563 None] Create snapshot completed successfully Sep 23 12:54:51 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-6aee17f9-dc60-48ff-991a-cbd313668752" returned: 0 in 0.286s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-6aee17f9-dc60-48ff-991a-cbd313668752" released by "delete_volume" :: held 0.753s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:51 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] Created reservations ['95d27332-107a-4d6d-bc90-c645d4ac9dd6', '68539e96-0ddc-42c2-8bf5-ce34c658279e', 'e4edd41f-ddfa-448a-8cf0-22abfd3d32c7', 'cf463264-25a5-4fa0-90ea-e0c51c090f2a'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:51 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:51 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:51 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.263s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:51 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:51 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] Deleted volume successfully. Sep 23 12:54:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6f84d9eb-f69c-434c-8b62-0a50e73f3900 tempest-ProjectReaderTests-114244591 None] Lock "cinder-6aee17f9-dc60-48ff-991a-cbd313668752-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Flow 'volume_create_manager' (aeedf22e-219d-4520-8972-3829030d8cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dffa544a-65ce-4aff-a978-41d6ca17017b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dffa544a-65ce-4aff-a978-41d6ca17017b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-310494685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=592f42bc-dd65-44be-a38d-37db8a6ee7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee4f1f0988249b2850ee72b9fbc8d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:52Z,use_quota=True,user_id='e0d279fe88cb4faabec257031d9aeda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3f0ee7-c207-4778-bbd2-a1553920a4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3f0ee7-c207-4778-bbd2-a1553920a4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108c3683-0e63-4ee5-8c38-a782fdb6081d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108c3683-0e63-4ee5-8c38-a782fdb6081d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '592f42bc-dd65-44be-a38d-37db8a6ee7b7', 'volume_name': 'volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940e6e92-79e7-47cd-b811-967826b74264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940e6e92-79e7-47cd-b811-967826b74264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f793721-83f7-4553-9457-71376f965070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:52 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Volume 592f42bc-dd65-44be-a38d-37db8a6ee7b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7', 'volume_size': 1} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-310494685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=592f42bc-dd65-44be-a38d-37db8a6ee7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee4f1f0988249b2850ee72b9fbc8d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:52Z,use_quota=True,user_id='e0d279fe88cb4faabec257031d9aeda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Creating volume 592f42bc-dd65-44be-a38d-37db8a6ee7b7 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:54:52 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-c6939231-42d6-48be-8da7-dcac551c81d4-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:52 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7 1073741824 Sep 23 12:54:52 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] Lock "cinder-c6939231-42d6-48be-8da7-dcac551c81d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-83ea129b-b254-4d66-b033-2e0a3377f49f" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-83ea129b-b254-4d66-b033-2e0a3377f49f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-c6939231-42d6-48be-8da7-dcac551c81d4" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-c6939231-42d6-48be-8da7-dcac551c81d4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] Deleting offline snapshot c6939231-42d6-48be-8da7-dcac551c81d4 of volume 83ea129b-b254-4d66-b033-2e0a3377f49f {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] snapshot_file for this snap is: volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f13539-17d2-4c25-98a0-511f1dd35a3a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:52 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4 Sep 23 12:54:52 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:52 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7 1073741824" returned: 0 in 0.458s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:52 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7 Sep 23 12:54:52 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:52 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4" returned: 0 in 0.427s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:52 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83ea129b-b254-4d66-b033-2e0a3377f49f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:54:53 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a007b2b3-1d37-46c1-a784-238366a54dda]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:53 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f Sep 23 12:54:53 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:53 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7" returned: 0 in 0.257s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:53 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:54:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f793721-83f7-4553-9457-71376f965070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (021cfa15-c9c3-4f15-84a6-734ba8218517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:53 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Volume volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7 (592f42bc-dd65-44be-a38d-37db8a6ee7b7): created successfully Sep 23 12:54:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (021cfa15-c9c3-4f15-84a6-734ba8218517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:53 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Flow 'volume_create_manager' (aeedf22e-219d-4520-8972-3829030d8cc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:53 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-07aafb46-a714-4f5d-8234-cdcf7b98c7e1 tempest-ProjectReaderTests-114244591 None] Created volume successfully. Sep 23 12:54:53 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f" returned: 0 in 0.385s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:53 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4 Sep 23 12:54:53 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:53 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4" returned: 0 in 0.338s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:53 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4 Sep 23 12:54:53 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:53 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f.c6939231-42d6-48be-8da7-dcac551c81d4" returned: 0 in 0.246s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-c6939231-42d6-48be-8da7-dcac551c81d4" released by "_delete_snapshot" :: held 1.525s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-83ea129b-b254-4d66-b033-2e0a3377f49f" released by "delete_snapshot" :: held 1.549s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:54 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] Created reservations ['5d9e5cf8-92f3-4c0e-ac96-ee7ca8d44bf8', 'd4534de8-ede0-4895-90df-d7f9d4e703a0', 'e0ced6db-bfc0-40a4-9ebe-ed7e574c6b9c', '0053a7c7-659b-41d3-b0e7-d2acf05e2d79'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:54 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] Delete snapshot completed successfully. Sep 23 12:54:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-af9b9944-1eeb-4b47-955d-1f7b0b4cac1b tempest-ProjectMemberTests-1374908563 None] Lock "cinder-c6939231-42d6-48be-8da7-dcac551c81d4-delete_snapshot" released by "delete_snapshot" :: held 1.688s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9e31f0d0-6c50-432c-8bfd-b87fd1c50091 tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9e31f0d0-6c50-432c-8bfd-b87fd1c50091 tempest-ProjectReaderTests-114244591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-9e31f0d0-6c50-432c-8bfd-b87fd1c50091 tempest-ProjectReaderTests-114244591 None] Creating offline snapshot 22a15a59-f014-4e8b-9410-e56c805f7141 of volume 592f42bc-dd65-44be-a38d-37db8a6ee7b7 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:54:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-83ea129b-b254-4d66-b033-2e0a3377f49f-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-83ea129b-b254-4d66-b033-2e0a3377f49f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:54 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[448ec5f8-a986-4339-ab09-55aa80ad598e]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e31f0d0-6c50-432c-8bfd-b87fd1c50091 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-83ea129b-b254-4d66-b033-2e0a3377f49f" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-83ea129b-b254-4d66-b033-2e0a3377f49f" acquired by "delete_volume" :: waited 0.023s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:54 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[134583a0-d64a-405b-96bc-bc59f339112c]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:54 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7 Sep 23 12:54:54 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:54 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f Sep 23 12:54:54 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:55 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e31f0d0-6c50-432c-8bfd-b87fd1c50091 tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7" returned: 0 in 0.425s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e31f0d0-6c50-432c-8bfd-b87fd1c50091 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:55 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141 1G Sep 23 12:54:55 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:55 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f" returned: 0 in 0.407s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:55 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f Sep 23 12:54:55 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:55 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-83ea129b-b254-4d66-b033-2e0a3377f49f" returned: 0 in 0.296s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:55 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-83ea129b-b254-4d66-b033-2e0a3377f49f" released by "delete_volume" :: held 0.791s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:55 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e31f0d0-6c50-432c-8bfd-b87fd1c50091 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141 1G" returned: 0 in 0.471s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e31f0d0-6c50-432c-8bfd-b87fd1c50091 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:55 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141 Sep 23 12:54:55 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:55 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] Created reservations ['35d52cd5-07a8-4447-b243-af3f7b158dd1', '6c3f3ad0-70a2-4d36-906b-9833902cda40', '286c13c0-ac25-4997-8c55-102a47ef6d5f', '18ceda2d-f4e4-4b69-bcdc-2867c3d92e1e'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:55 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:54:55 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:55 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e31f0d0-6c50-432c-8bfd-b87fd1c50091 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141" returned: 0 in 0.375s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:55 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-9e31f0d0-6c50-432c-8bfd-b87fd1c50091 tempest-ProjectReaderTests-114244591 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141 is being set with open permissions: ugo+rw Sep 23 12:54:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e31f0d0-6c50-432c-8bfd-b87fd1c50091 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:55 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141 Sep 23 12:54:55 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:55 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.323s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:55 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:54:55 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] Deleted volume successfully. Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-af354838-1037-4b24-979e-6627d943db18 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-83ea129b-b254-4d66-b033-2e0a3377f49f-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:56 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e31f0d0-6c50-432c-8bfd-b87fd1c50091 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141" returned: 0 in 0.298s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e31f0d0-6c50-432c-8bfd-b87fd1c50091 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:56 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.info Sep 23 12:54:56 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Flow 'volume_create_manager' (167fb56f-9d1d-4016-b9a7-eae6cde5d1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f936d386-75b5-46af-a829-ef58db8ceee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f936d386-75b5-46af-a829-ef58db8ceee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878786111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2179cd-bc85-4930-95ca-ae949b58d00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fdcd86a5cf44b7bf3afc72ccee4603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:56Z,use_quota=True,user_id='399ebb30c0be43a0b1a2458707bca670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f3bea5-34c3-4648-8679-03d18de226e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f3bea5-34c3-4648-8679-03d18de226e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d50a47-b5c5-4edb-8694-cdae96ad5d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d50a47-b5c5-4edb-8694-cdae96ad5d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d2179cd-bc85-4930-95ca-ae949b58d00a', 'volume_name': 'volume-3d2179cd-bc85-4930-95ca-ae949b58d00a', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37dc88b8-d367-4db1-a4ad-9d07ff7f06aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37dc88b8-d367-4db1-a4ad-9d07ff7f06aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986aceb8-c4f7-45ff-8fab-61e529f19794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:56 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Volume 3d2179cd-bc85-4930-95ca-ae949b58d00a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d2179cd-bc85-4930-95ca-ae949b58d00a', 'volume_size': 1} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:56 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e31f0d0-6c50-432c-8bfd-b87fd1c50091 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.info" returned: 0 in 0.280s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:56 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-9e31f0d0-6c50-432c-8bfd-b87fd1c50091 tempest-ProjectReaderTests-114244591 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.info is being set with open permissions: ugo+rw Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e31f0d0-6c50-432c-8bfd-b87fd1c50091 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:56 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.info Sep 23 12:54:56 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:56 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e31f0d0-6c50-432c-8bfd-b87fd1c50091 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.info" returned: 0 in 0.252s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9e31f0d0-6c50-432c-8bfd-b87fd1c50091 tempest-ProjectReaderTests-114244591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.218s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.356s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878786111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2179cd-bc85-4930-95ca-ae949b58d00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fdcd86a5cf44b7bf3afc72ccee4603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:54:56Z,use_quota=True,user_id='399ebb30c0be43a0b1a2458707bca670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Creating volume 3d2179cd-bc85-4930-95ca-ae949b58d00a {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:54:56 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:54:56 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:56 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a 1073741824 Sep 23 12:54:56 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:56 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-9e31f0d0-6c50-432c-8bfd-b87fd1c50091 tempest-ProjectReaderTests-114244591 None] Create snapshot completed successfully Sep 23 12:54:57 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a 1073741824" returned: 0 in 0.424s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:57 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a Sep 23 12:54:57 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:57 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a" returned: 0 in 0.231s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:54:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:54:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986aceb8-c4f7-45ff-8fab-61e529f19794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d2179cd-bc85-4930-95ca-ae949b58d00a', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc592422-4bf7-4ef6-b2ac-e5f77b2ed3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:54:57 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Volume volume-3d2179cd-bc85-4930-95ca-ae949b58d00a (3d2179cd-bc85-4930-95ca-ae949b58d00a): created successfully Sep 23 12:54:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc592422-4bf7-4ef6-b2ac-e5f77b2ed3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:54:57 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Flow 'volume_create_manager' (167fb56f-9d1d-4016-b9a7-eae6cde5d1c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:54:57 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0ab4b01a-dc23-4d8c-86c1-d5309cee0860 tempest-ProjectMemberTests-1374908563 None] Created volume successfully. Sep 23 12:54:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-22a15a59-f014-4e8b-9410-e56c805f7141-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] Lock "cinder-22a15a59-f014-4e8b-9410-e56c805f7141-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-quobyte-592f42bc-dd65-44be-a38d-37db8a6ee7b7" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-592f42bc-dd65-44be-a38d-37db8a6ee7b7" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-quobyte-22a15a59-f014-4e8b-9410-e56c805f7141" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:57 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-22a15a59-f014-4e8b-9410-e56c805f7141" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] Deleting offline snapshot 22a15a59-f014-4e8b-9410-e56c805f7141 of volume 592f42bc-dd65-44be-a38d-37db8a6ee7b7 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:54:57 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] snapshot_file for this snap is: volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:54:57 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[22413673-fa43-4869-be85-fce21e5d8e0b]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:57 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:57 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141 Sep 23 12:54:57 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:58 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141" returned: 0 in 0.342s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:54:58 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b585a9-814f-4f5d-aff3-21822b586eeb]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:58 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7 Sep 23 12:54:58 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:58 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7" returned: 0 in 0.365s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:58 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141 Sep 23 12:54:58 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9e3cc862-d614-49f4-b00f-7a15be145538 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:54:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9e3cc862-d614-49f4-b00f-7a15be145538 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:54:58 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-9e3cc862-d614-49f4-b00f-7a15be145538 tempest-ProjectMemberTests-1374908563 None] Creating offline snapshot 04098020-f917-402f-b166-a07b9d591686 of volume 3d2179cd-bc85-4930-95ca-ae949b58d00a {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:54:58 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a642199-b1fa-4cd7-b6a5-cbe1089bc4aa]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:54:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e3cc862-d614-49f4-b00f-7a15be145538 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:58 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a Sep 23 12:54:58 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:58 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141" returned: 0 in 0.348s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:58 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141 Sep 23 12:54:58 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:58 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:58 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e3cc862-d614-49f4-b00f-7a15be145538 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a" returned: 0 in 0.378s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e3cc862-d614-49f4-b00f-7a15be145538 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:59 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686 1G Sep 23 12:54:59 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:59 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7.22a15a59-f014-4e8b-9410-e56c805f7141" returned: 0 in 0.265s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-22a15a59-f014-4e8b-9410-e56c805f7141" released by "_delete_snapshot" :: held 1.423s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-592f42bc-dd65-44be-a38d-37db8a6ee7b7" released by "delete_snapshot" :: held 1.443s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:59 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] Created reservations ['fb4b6b35-c260-4961-ba80-8aa159e9a065', '296d523f-1635-4e45-a37b-711cd5e6c622', 'f59ef4d1-aaf2-4fd4-a495-984abf654502', '5ceb0e2c-d216-4250-8af5-3df5ad3da773'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:54:59 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] Delete snapshot completed successfully. Sep 23 12:54:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-3ed8678b-f754-46de-8acd-f6d91e1aee0a tempest-ProjectReaderTests-114244591 None] Lock "cinder-22a15a59-f014-4e8b-9410-e56c805f7141-delete_snapshot" released by "delete_snapshot" :: held 1.572s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:54:59 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e3cc862-d614-49f4-b00f-7a15be145538 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686 1G" returned: 0 in 0.410s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e3cc862-d614-49f4-b00f-7a15be145538 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d2179cd-bc85-4930-95ca-ae949b58d00a -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:59 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d2179cd-bc85-4930-95ca-ae949b58d00a -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686 Sep 23 12:54:59 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:59 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e3cc862-d614-49f4-b00f-7a15be145538 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d2179cd-bc85-4930-95ca-ae949b58d00a -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686" returned: 0 in 0.271s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:59 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-9e3cc862-d614-49f4-b00f-7a15be145538 tempest-ProjectMemberTests-1374908563 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686 is being set with open permissions: ugo+rw Sep 23 12:54:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e3cc862-d614-49f4-b00f-7a15be145538 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:54:59 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686 Sep 23 12:54:59 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:54:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-592f42bc-dd65-44be-a38d-37db8a6ee7b7-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] Lock "cinder-592f42bc-dd65-44be-a38d-37db8a6ee7b7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:54:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-quobyte-592f42bc-dd65-44be-a38d-37db8a6ee7b7" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:54:59 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 23 12:54:59 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e3cc862-d614-49f4-b00f-7a15be145538 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686" returned: 0 in 0.257s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:54:59 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-592f42bc-dd65-44be-a38d-37db8a6ee7b7" acquired by "delete_volume" :: waited 0.034s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e3cc862-d614-49f4-b00f-7a15be145538 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bc36ec-1ae3-413d-a79c-b54677f702e4]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:00 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.info Sep 23 12:55:00 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:00 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7 Sep 23 12:55:00 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:00 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e3cc862-d614-49f4-b00f-7a15be145538 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.info" returned: 0 in 0.251s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:00 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-9e3cc862-d614-49f4-b00f-7a15be145538 tempest-ProjectMemberTests-1374908563 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.info is being set with open permissions: ugo+rw Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e3cc862-d614-49f4-b00f-7a15be145538 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:00 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.info Sep 23 12:55:00 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:00 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7" returned: 0 in 0.355s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:00 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7 Sep 23 12:55:00 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:00 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-9e3cc862-d614-49f4-b00f-7a15be145538 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.info" returned: 0 in 0.246s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-9e3cc862-d614-49f4-b00f-7a15be145538 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.939s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:00 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-9e3cc862-d614-49f4-b00f-7a15be145538 tempest-ProjectMemberTests-1374908563 None] Create snapshot completed successfully Sep 23 12:55:00 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-592f42bc-dd65-44be-a38d-37db8a6ee7b7" returned: 0 in 0.268s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-592f42bc-dd65-44be-a38d-37db8a6ee7b7" released by "delete_volume" :: held 0.698s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] Created reservations ['8458c360-3c45-4e73-bb65-dd75d48bb3f9', 'a531c39f-3ba9-49e9-8031-2252c26b4a3c', '53a712d8-181e-4067-8c96-59845c5dcb0c', '098553e9-c8d4-413f-8693-f1091396bd2e'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-04098020-f917-402f-b166-a07b9d591686-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] Lock "cinder-04098020-f917-402f-b166-a07b9d591686-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-3d2179cd-bc85-4930-95ca-ae949b58d00a" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-3d2179cd-bc85-4930-95ca-ae949b58d00a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-04098020-f917-402f-b166-a07b9d591686" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-04098020-f917-402f-b166-a07b9d591686" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] Deleting offline snapshot 04098020-f917-402f-b166-a07b9d591686 of volume 3d2179cd-bc85-4930-95ca-ae949b58d00a {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:55:00 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:55:00 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] snapshot_file for this snap is: volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[538aea88-b537-48f2-a042-d30ae8acf1b5]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:00 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:00 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686 Sep 23 12:55:00 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:01 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.254s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:55:01 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] Deleted volume successfully. Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-023ee1b6-6ac1-4f7f-81bc-b946ff2719cd tempest-ProjectReaderTests-114244591 None] Lock "cinder-592f42bc-dd65-44be-a38d-37db8a6ee7b7-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:01 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686" returned: 0 in 0.399s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d2179cd-bc85-4930-95ca-ae949b58d00a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c41017d-7414-4ea7-b711-49531335c5bb]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:01 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a Sep 23 12:55:01 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Flow 'volume_create_manager' (4228232a-97e3-413f-8ebb-030bb03d3b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a5836fe-b708-45df-85c9-e0eb94729163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a5836fe-b708-45df-85c9-e0eb94729163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-47758922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3bb53b-a31f-4850-b7ce-cf9f09552dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee4f1f0988249b2850ee72b9fbc8d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:55:01Z,use_quota=True,user_id='e0d279fe88cb4faabec257031d9aeda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b7c389-b477-495b-8a69-1f69eaea0642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b7c389-b477-495b-8a69-1f69eaea0642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbba9d98-5f70-411a-abd8-6dc5bf0ea657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbba9d98-5f70-411a-abd8-6dc5bf0ea657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b3bb53b-a31f-4850-b7ce-cf9f09552dd5', 'volume_name': 'volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248819c6-3fe8-4950-a44c-f6399069f188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248819c6-3fe8-4950-a44c-f6399069f188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e24d2c-ea5c-42a8-a4d8-704ba3a650d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:01 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Volume 1b3bb53b-a31f-4850-b7ce-cf9f09552dd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5', 'volume_size': 1} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-47758922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3bb53b-a31f-4850-b7ce-cf9f09552dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee4f1f0988249b2850ee72b9fbc8d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:55:01Z,use_quota=True,user_id='e0d279fe88cb4faabec257031d9aeda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Creating volume 1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:55:01 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:01 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 1073741824 Sep 23 12:55:01 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:01 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a" returned: 0 in 0.378s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:01 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:01 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686 Sep 23 12:55:01 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:02 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686" returned: 0 in 0.355s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:02 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:02 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686 Sep 23 12:55:02 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 1073741824" returned: 0 in 0.439s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:02 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 Sep 23 12:55:02 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:02 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a.04098020-f917-402f-b166-a07b9d591686" returned: 0 in 0.246s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-04098020-f917-402f-b166-a07b9d591686" released by "_delete_snapshot" :: held 1.494s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-3d2179cd-bc85-4930-95ca-ae949b58d00a" released by "delete_snapshot" :: held 1.536s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:02 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5" returned: 0 in 0.253s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e24d2c-ea5c-42a8-a4d8-704ba3a650d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9585de-a1b1-439f-9bb9-79bbe52f4114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:02 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Volume volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 (1b3bb53b-a31f-4850-b7ce-cf9f09552dd5): created successfully Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9585de-a1b1-439f-9bb9-79bbe52f4114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Flow 'volume_create_manager' (4228232a-97e3-413f-8ebb-030bb03d3b13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:55:02 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-59998e3b-4f8c-49d5-8453-178a38624862 tempest-ProjectReaderTests-114244591 None] Created volume successfully. Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] Created reservations ['6ee43c64-a498-49a6-b0e0-4f4432e30b93', '8badf760-aa3a-4e89-a915-60d2acc33c85', 'cea83b11-c887-4e7a-b310-ea821a0f27ee', 'ef5b4dd1-62a8-43ad-b047-9d14cf49e502'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:55:02 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] Delete snapshot completed successfully. Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b36bebc7-255c-49b0-9874-07d78e11f7da tempest-ProjectMemberTests-1374908563 None] Lock "cinder-04098020-f917-402f-b166-a07b9d591686-delete_snapshot" released by "delete_snapshot" :: held 1.724s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d07db0b6-e731-4349-aa25-1ce78a224eff tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d07db0b6-e731-4349-aa25-1ce78a224eff tempest-ProjectReaderTests-114244591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-d07db0b6-e731-4349-aa25-1ce78a224eff tempest-ProjectReaderTests-114244591 None] Creating offline snapshot 5ce50b84-950c-42de-845d-a7f3c2937c94 of volume 1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[06134e38-f53d-4c20-8151-20c18d4fdde9]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d07db0b6-e731-4349-aa25-1ce78a224eff tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:02 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 Sep 23 12:55:02 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-3d2179cd-bc85-4930-95ca-ae949b58d00a-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-3d2179cd-bc85-4930-95ca-ae949b58d00a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-3d2179cd-bc85-4930-95ca-ae949b58d00a" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:02 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-3d2179cd-bc85-4930-95ca-ae949b58d00a" acquired by "delete_volume" :: waited 0.015s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:03 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51d082b-2018-4ad0-a27b-75d78185b908]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:03 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d07db0b6-e731-4349-aa25-1ce78a224eff tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5" returned: 0 in 0.395s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d07db0b6-e731-4349-aa25-1ce78a224eff tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:03 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94 1G Sep 23 12:55:03 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:03 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a Sep 23 12:55:03 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:03 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a" returned: 0 in 0.375s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:03 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a Sep 23 12:55:03 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:03 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d07db0b6-e731-4349-aa25-1ce78a224eff tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94 1G" returned: 0 in 0.395s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d07db0b6-e731-4349-aa25-1ce78a224eff tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:03 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94 Sep 23 12:55:03 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:03 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-3d2179cd-bc85-4930-95ca-ae949b58d00a" returned: 0 in 0.248s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:03 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-3d2179cd-bc85-4930-95ca-ae949b58d00a" released by "delete_volume" :: held 0.694s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:03 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] Created reservations ['15f6ee9c-2101-47af-b03e-5986c10df63d', '2e7a22c6-3838-4cca-b625-4320ea8ee2ea', '423a56ab-b118-433d-a593-f8e861288b7e', 'da19343d-ce48-4ad2-bd90-219668778fdf'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:55:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:55:03 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:55:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:03 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:03 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:55:03 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d07db0b6-e731-4349-aa25-1ce78a224eff tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94" returned: 0 in 0.312s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:03 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-d07db0b6-e731-4349-aa25-1ce78a224eff tempest-ProjectReaderTests-114244591 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94 is being set with open permissions: ugo+rw Sep 23 12:55:03 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d07db0b6-e731-4349-aa25-1ce78a224eff tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:03 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94 Sep 23 12:55:03 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:04 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.237s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:55:04 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] Deleted volume successfully. Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b5ececb7-ae5c-4751-a891-8d0f4558fd44 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-3d2179cd-bc85-4930-95ca-ae949b58d00a-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:04 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d07db0b6-e731-4349-aa25-1ce78a224eff tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94" returned: 0 in 0.250s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d07db0b6-e731-4349-aa25-1ce78a224eff tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:04 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.info Sep 23 12:55:04 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:04 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d07db0b6-e731-4349-aa25-1ce78a224eff tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.info" returned: 0 in 0.254s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:04 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-d07db0b6-e731-4349-aa25-1ce78a224eff tempest-ProjectReaderTests-114244591 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.info is being set with open permissions: ugo+rw Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d07db0b6-e731-4349-aa25-1ce78a224eff tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:04 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.info Sep 23 12:55:04 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Flow 'volume_create_manager' (1d36e8c1-58ef-4a95-9965-a76e3a6d0202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d282c8-bc1b-45e3-8636-8ed1d9956e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d282c8-bc1b-45e3-8636-8ed1d9956e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1063653998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84bd3f44-6238-4fae-99fb-da35cc6a3818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fdcd86a5cf44b7bf3afc72ccee4603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:55:04Z,use_quota=True,user_id='399ebb30c0be43a0b1a2458707bca670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1002b43-5531-4dfd-b9e0-c28f31ad7488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1002b43-5531-4dfd-b9e0-c28f31ad7488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34c5d00-272d-436a-af23-5682ebbf053c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34c5d00-272d-436a-af23-5682ebbf053c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84bd3f44-6238-4fae-99fb-da35cc6a3818', 'volume_name': 'volume-84bd3f44-6238-4fae-99fb-da35cc6a3818', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05d8b49-54a1-4d7c-b287-602edcb73fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:04 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05d8b49-54a1-4d7c-b287-602edcb73fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf6d2d4-0ec6-4234-b5fc-aea0e17d5aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:04 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Volume 84bd3f44-6238-4fae-99fb-da35cc6a3818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84bd3f44-6238-4fae-99fb-da35cc6a3818', 'volume_size': 1} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-d07db0b6-e731-4349-aa25-1ce78a224eff tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.info" returned: 0 in 0.254s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-d07db0b6-e731-4349-aa25-1ce78a224eff tempest-ProjectReaderTests-114244591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1063653998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84bd3f44-6238-4fae-99fb-da35cc6a3818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fdcd86a5cf44b7bf3afc72ccee4603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:55:04Z,use_quota=True,user_id='399ebb30c0be43a0b1a2458707bca670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Creating volume 84bd3f44-6238-4fae-99fb-da35cc6a3818 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:55:04 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:04 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818 1073741824 Sep 23 12:55:04 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:04 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-d07db0b6-e731-4349-aa25-1ce78a224eff tempest-ProjectReaderTests-114244591 None] Create snapshot completed successfully Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-5ce50b84-950c-42de-845d-a7f3c2937c94-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] Lock "cinder-5ce50b84-950c-42de-845d-a7f3c2937c94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-quobyte-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-quobyte-5ce50b84-950c-42de-845d-a7f3c2937c94" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-5ce50b84-950c-42de-845d-a7f3c2937c94" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] Deleting offline snapshot 5ce50b84-950c-42de-845d-a7f3c2937c94 of volume 1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] snapshot_file for this snap is: volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb984e74-2b47-4172-ab3b-9655982628f1]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:04 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:05 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94 Sep 23 12:55:05 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:05 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818 1073741824" returned: 0 in 0.424s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:05 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818 Sep 23 12:55:05 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:05 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94" returned: 0 in 0.359s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f917bb6-4a4d-4bc7-a656-0d1a514178ce]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:05 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818" returned: 0 in 0.244s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf6d2d4-0ec6-4234-b5fc-aea0e17d5aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84bd3f44-6238-4fae-99fb-da35cc6a3818', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed7ae065-f673-4452-a2fd-62b7c5c739fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:05 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Volume volume-84bd3f44-6238-4fae-99fb-da35cc6a3818 (84bd3f44-6238-4fae-99fb-da35cc6a3818): created successfully Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed7ae065-f673-4452-a2fd-62b7c5c739fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Flow 'volume_create_manager' (1d36e8c1-58ef-4a95-9965-a76e3a6d0202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:55:05 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-e396efac-49fb-42a4-bc2a-30c5d34e8678 tempest-ProjectMemberTests-1374908563 None] Created volume successfully. Sep 23 12:55:05 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 Sep 23 12:55:05 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:05 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5" returned: 0 in 0.390s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-43f15b01-d339-48e3-a312-55b79be6609f tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-43f15b01-d339-48e3-a312-55b79be6609f tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:05 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94 Sep 23 12:55:05 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-43f15b01-d339-48e3-a312-55b79be6609f tempest-ProjectMemberTests-1374908563 None] Creating offline snapshot ad433f9c-2e6b-4331-ac08-b5af98a54f38 of volume 84bd3f44-6238-4fae-99fb-da35cc6a3818 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dee6ad-2312-4f73-b013-0f5d2f49c5da]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:05 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-43f15b01-d339-48e3-a312-55b79be6609f tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:05 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818 Sep 23 12:55:05 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:06 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94" returned: 0 in 0.333s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:06 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94 Sep 23 12:55:06 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:06 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-43f15b01-d339-48e3-a312-55b79be6609f tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818" returned: 0 in 0.380s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-43f15b01-d339-48e3-a312-55b79be6609f tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:06 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38 1G Sep 23 12:55:06 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:06 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5.5ce50b84-950c-42de-845d-a7f3c2937c94" returned: 0 in 0.256s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:06 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-5ce50b84-950c-42de-845d-a7f3c2937c94" released by "_delete_snapshot" :: held 1.436s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:06 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5" released by "delete_snapshot" :: held 1.461s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:06 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] Created reservations ['b2d46ab3-46ad-4813-b410-df97e91ae16d', '8e43d53e-2857-44f9-a2ee-fb3d4076668e', '9ad8c02b-6b10-4b15-8949-acec1e9dfcdd', '934694bb-d636-49ab-878c-18d3ddbdc63c'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:55:06 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] Delete snapshot completed successfully. Sep 23 12:55:06 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-a717d7f1-6ce6-4f53-af9a-fc2c28cce9f6 tempest-ProjectReaderTests-114244591 None] Lock "cinder-5ce50b84-950c-42de-845d-a7f3c2937c94-delete_snapshot" released by "delete_snapshot" :: held 1.598s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:06 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-43f15b01-d339-48e3-a312-55b79be6609f tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38 1G" returned: 0 in 0.416s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-43f15b01-d339-48e3-a312-55b79be6609f tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84bd3f44-6238-4fae-99fb-da35cc6a3818 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:06 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84bd3f44-6238-4fae-99fb-da35cc6a3818 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38 Sep 23 12:55:06 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:06 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-43f15b01-d339-48e3-a312-55b79be6609f tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84bd3f44-6238-4fae-99fb-da35cc6a3818 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38" returned: 0 in 0.282s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:06 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-43f15b01-d339-48e3-a312-55b79be6609f tempest-ProjectMemberTests-1374908563 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38 is being set with open permissions: ugo+rw Sep 23 12:55:06 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-43f15b01-d339-48e3-a312-55b79be6609f tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:06 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38 Sep 23 12:55:06 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:06 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:06 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] Lock "cinder-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] Acquiring lock "cinder-quobyte-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5" acquired by "delete_volume" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:07 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-43f15b01-d339-48e3-a312-55b79be6609f tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38" returned: 0 in 0.260s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[07378052-2ca8-4395-9a6a-04179f8416c0]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-43f15b01-d339-48e3-a312-55b79be6609f tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:07 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.info Sep 23 12:55:07 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:07 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 Sep 23 12:55:07 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:07 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-43f15b01-d339-48e3-a312-55b79be6609f tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.info" returned: 0 in 0.248s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:07 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-43f15b01-d339-48e3-a312-55b79be6609f tempest-ProjectMemberTests-1374908563 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.info is being set with open permissions: ugo+rw Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-43f15b01-d339-48e3-a312-55b79be6609f tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:07 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.info Sep 23 12:55:07 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:07 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5" returned: 0 in 0.359s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:07 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5 Sep 23 12:55:07 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:07 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-43f15b01-d339-48e3-a312-55b79be6609f tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.info" returned: 0 in 0.254s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-43f15b01-d339-48e3-a312-55b79be6609f tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:07 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-43f15b01-d339-48e3-a312-55b79be6609f tempest-ProjectMemberTests-1374908563 None] Create snapshot completed successfully Sep 23 12:55:07 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5" returned: 0 in 0.272s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] Lock "cinder-quobyte-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5" released by "delete_volume" :: held 0.700s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] Created reservations ['131cd948-d22c-463c-b04f-9d7bfacf64db', 'bcb75cca-cdea-45c4-9784-6a75cd7becbe', '4d294600-2637-435c-af4d-965eca5ee989', '73dc578d-41a9-4058-b5ef-86bdab29c724'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-ad433f9c-2e6b-4331-ac08-b5af98a54f38-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] Lock "cinder-ad433f9c-2e6b-4331-ac08-b5af98a54f38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-84bd3f44-6238-4fae-99fb-da35cc6a3818" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-84bd3f44-6238-4fae-99fb-da35cc6a3818" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-ad433f9c-2e6b-4331-ac08-b5af98a54f38" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-ad433f9c-2e6b-4331-ac08-b5af98a54f38" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] Deleting offline snapshot ad433f9c-2e6b-4331-ac08-b5af98a54f38 of volume 84bd3f44-6238-4fae-99fb-da35cc6a3818 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:55:07 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:55:07 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] snapshot_file for this snap is: volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[116b580b-e444-42dd-b446-6a5c41d8755e]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:07 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:08 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38 Sep 23 12:55:08 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:08 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.286s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:08 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:55:08 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] Deleted volume successfully. Sep 23 12:55:08 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-b6bf2e56-21b9-4fc4-aaf3-50f42067a738 tempest-ProjectReaderTests-114244591 None] Lock "cinder-1b3bb53b-a31f-4850-b7ce-cf9f09552dd5-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:08 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38" returned: 0 in 0.383s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:08 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84bd3f44-6238-4fae-99fb-da35cc6a3818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:55:08 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[551acc4f-43a9-482a-8eff-35201f476d01]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:08 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818 Sep 23 12:55:08 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:08 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818" returned: 0 in 0.361s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:08 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:08 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38 Sep 23 12:55:08 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:09 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38" returned: 0 in 0.373s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:09 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38 Sep 23 12:55:09 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:09 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:09 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818.ad433f9c-2e6b-4331-ac08-b5af98a54f38" returned: 0 in 0.267s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-ad433f9c-2e6b-4331-ac08-b5af98a54f38" released by "_delete_snapshot" :: held 1.492s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-84bd3f44-6238-4fae-99fb-da35cc6a3818" released by "delete_snapshot" :: held 1.529s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:09 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] Created reservations ['b109a52a-c5c1-4c98-925f-d434cf15904d', '92d2eca7-013f-4d27-a8e6-0879e343543b', '17b039b1-cfc6-4ef1-bebe-36e63bc62368', '4661f8f0-cd70-4883-898e-8369cba43b6d'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:55:09 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] Delete snapshot completed successfully. Sep 23 12:55:09 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c64c7a8e-0b9f-47a0-8bd4-05093c5181aa tempest-ProjectMemberTests-1374908563 None] Lock "cinder-ad433f9c-2e6b-4331-ac08-b5af98a54f38-delete_snapshot" released by "delete_snapshot" :: held 1.701s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-84bd3f44-6238-4fae-99fb-da35cc6a3818-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-84bd3f44-6238-4fae-99fb-da35cc6a3818-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-84bd3f44-6238-4fae-99fb-da35cc6a3818" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-84bd3f44-6238-4fae-99fb-da35cc6a3818" acquired by "delete_volume" :: waited 0.015s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:10 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d988bf-c9c7-4bc7-a5af-8839f250e9fe]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:10 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818 Sep 23 12:55:10 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:10 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818" returned: 0 in 0.383s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:10 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818 Sep 23 12:55:10 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:10 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-84bd3f44-6238-4fae-99fb-da35cc6a3818" returned: 0 in 0.249s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:10 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-84bd3f44-6238-4fae-99fb-da35cc6a3818" released by "delete_volume" :: held 0.701s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:10 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] Created reservations ['e3cd6f8b-6436-4dce-b33f-c0d5f76ba082', 'fb6abdf7-69c5-475d-b66b-8529bf59d11b', '8a7d8e88-c355-4470-ba30-8150983504ff', '24c4579e-540b-4f11-9c71-7452433dbdfd'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:55:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:10 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:55:10 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:55:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:10 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:10 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:55:10 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:11 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.268s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:55:11 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] Deleted volume successfully. Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-19c38888-4250-49ec-82fc-fc972a339813 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-84bd3f44-6238-4fae-99fb-da35cc6a3818-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Flow 'volume_create_manager' (7c084018-2212-4dce-b39b-dba08843220a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a837459a-a7ce-4ea7-9d2c-ded5777efcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a837459a-a7ce-4ea7-9d2c-ded5777efcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-307424929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e03bd1-430c-4fef-8863-e91659da3f0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fdcd86a5cf44b7bf3afc72ccee4603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:55:12Z,use_quota=True,user_id='399ebb30c0be43a0b1a2458707bca670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356cc81f-1aa6-438d-887b-d68a12ca837e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356cc81f-1aa6-438d-887b-d68a12ca837e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70707783-4a01-411d-bf0b-74d80f9add02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70707783-4a01-411d-bf0b-74d80f9add02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e03bd1-430c-4fef-8863-e91659da3f0c', 'volume_name': 'volume-65e03bd1-430c-4fef-8863-e91659da3f0c', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ddd06d-7161-470e-a055-c783776ed7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ddd06d-7161-470e-a055-c783776ed7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df1b10e5-9bcb-43d2-94cc-323921654ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:11 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Volume 65e03bd1-430c-4fef-8863-e91659da3f0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e03bd1-430c-4fef-8863-e91659da3f0c', 'volume_size': 1} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-307424929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e03bd1-430c-4fef-8863-e91659da3f0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fdcd86a5cf44b7bf3afc72ccee4603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:55:12Z,use_quota=True,user_id='399ebb30c0be43a0b1a2458707bca670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Creating volume 65e03bd1-430c-4fef-8863-e91659da3f0c {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:55:11 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:55:11 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:11 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c 1073741824 Sep 23 12:55:11 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:12 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c 1073741824" returned: 0 in 0.454s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:12 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c Sep 23 12:55:12 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:12 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c" returned: 0 in 0.228s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:55:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df1b10e5-9bcb-43d2-94cc-323921654ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e03bd1-430c-4fef-8863-e91659da3f0c', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb5e3ae-048f-4903-9ea9-3cd91451b9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:12 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Volume volume-65e03bd1-430c-4fef-8863-e91659da3f0c (65e03bd1-430c-4fef-8863-e91659da3f0c): created successfully Sep 23 12:55:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb5e3ae-048f-4903-9ea9-3cd91451b9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:12 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Flow 'volume_create_manager' (7c084018-2212-4dce-b39b-dba08843220a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:55:12 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-4d3460cb-5ffd-4998-ae2e-29489153d917 tempest-ProjectMemberTests-1374908563 None] Created volume successfully. Sep 23 12:55:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-61eba626-b5c8-41f1-961b-8a3752af9d2c tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-61eba626-b5c8-41f1-961b-8a3752af9d2c tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:12 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-61eba626-b5c8-41f1-961b-8a3752af9d2c tempest-ProjectMemberTests-1374908563 None] Creating offline snapshot f9cc1600-a09f-4423-a812-a16a638b8b1f of volume 65e03bd1-430c-4fef-8863-e91659da3f0c {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:55:12 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e444826-9a9f-444d-bb2f-2a1742755b30]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:12 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-61eba626-b5c8-41f1-961b-8a3752af9d2c tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:12 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c Sep 23 12:55:12 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:13 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-61eba626-b5c8-41f1-961b-8a3752af9d2c tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c" returned: 0 in 0.356s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-61eba626-b5c8-41f1-961b-8a3752af9d2c tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:13 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f 1G Sep 23 12:55:13 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:13 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-61eba626-b5c8-41f1-961b-8a3752af9d2c tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f 1G" returned: 0 in 0.409s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-61eba626-b5c8-41f1-961b-8a3752af9d2c tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65e03bd1-430c-4fef-8863-e91659da3f0c -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:13 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65e03bd1-430c-4fef-8863-e91659da3f0c -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f Sep 23 12:55:13 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:13 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-61eba626-b5c8-41f1-961b-8a3752af9d2c tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65e03bd1-430c-4fef-8863-e91659da3f0c -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f" returned: 0 in 0.324s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:13 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-61eba626-b5c8-41f1-961b-8a3752af9d2c tempest-ProjectMemberTests-1374908563 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f is being set with open permissions: ugo+rw Sep 23 12:55:13 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-61eba626-b5c8-41f1-961b-8a3752af9d2c tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:13 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f Sep 23 12:55:13 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:14 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-61eba626-b5c8-41f1-961b-8a3752af9d2c tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f" returned: 0 in 0.247s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-61eba626-b5c8-41f1-961b-8a3752af9d2c tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:14 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.info Sep 23 12:55:14 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:14 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-61eba626-b5c8-41f1-961b-8a3752af9d2c tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.info" returned: 0 in 0.256s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:14 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-61eba626-b5c8-41f1-961b-8a3752af9d2c tempest-ProjectMemberTests-1374908563 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.info is being set with open permissions: ugo+rw Sep 23 12:55:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-61eba626-b5c8-41f1-961b-8a3752af9d2c tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:14 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.info Sep 23 12:55:14 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:14 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-61eba626-b5c8-41f1-961b-8a3752af9d2c tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.info" returned: 0 in 0.258s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:14 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-61eba626-b5c8-41f1-961b-8a3752af9d2c tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.929s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:14 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-61eba626-b5c8-41f1-961b-8a3752af9d2c tempest-ProjectMemberTests-1374908563 None] Create snapshot completed successfully Sep 23 12:55:14 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-f9cc1600-a09f-4423-a812-a16a638b8b1f-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:14 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-f9cc1600-a09f-4423-a812-a16a638b8b1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:14 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-65e03bd1-430c-4fef-8863-e91659da3f0c" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:15 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-65e03bd1-430c-4fef-8863-e91659da3f0c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:15 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-f9cc1600-a09f-4423-a812-a16a638b8b1f" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:15 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-f9cc1600-a09f-4423-a812-a16a638b8b1f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] Deleting offline snapshot f9cc1600-a09f-4423-a812-a16a638b8b1f of volume 65e03bd1-430c-4fef-8863-e91659da3f0c {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:55:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] snapshot_file for this snap is: volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:55:15 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c32686-1d8f-470c-a60c-911389cf6344]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:15 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f Sep 23 12:55:15 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:15 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f" returned: 0 in 0.436s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:15 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65e03bd1-430c-4fef-8863-e91659da3f0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:55:15 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c15faba-f31b-40cb-bea5-1d3fed7f133a]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:15 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c Sep 23 12:55:15 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:15 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c" returned: 0 in 0.366s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:15 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:15 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f Sep 23 12:55:15 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:16 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f" returned: 0 in 0.316s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:16 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f Sep 23 12:55:16 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:16 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:16 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c.f9cc1600-a09f-4423-a812-a16a638b8b1f" returned: 0 in 0.241s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:16 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-f9cc1600-a09f-4423-a812-a16a638b8b1f" released by "_delete_snapshot" :: held 1.482s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:16 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-65e03bd1-430c-4fef-8863-e91659da3f0c" released by "delete_snapshot" :: held 1.510s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:16 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] Created reservations ['ae11f18b-af0a-41de-9822-4fb5a42e3490', 'e31bb179-296b-4f85-b099-dbec050bff81', '4d4c66c4-196d-4556-810c-f0614c673a72', '6f6bb553-0cfb-4b9a-9483-178b68146032'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:55:16 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] Delete snapshot completed successfully. Sep 23 12:55:16 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-c3f99645-89be-4b62-ab30-abb5f8eb9004 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-f9cc1600-a09f-4423-a812-a16a638b8b1f-delete_snapshot" released by "delete_snapshot" :: held 1.648s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-65e03bd1-430c-4fef-8863-e91659da3f0c-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-65e03bd1-430c-4fef-8863-e91659da3f0c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-65e03bd1-430c-4fef-8863-e91659da3f0c" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-65e03bd1-430c-4fef-8863-e91659da3f0c" acquired by "delete_volume" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:17 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[19198d2a-9ce8-4f25-a429-58df8563075d]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:17 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c Sep 23 12:55:17 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:17 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c" returned: 0 in 0.405s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:17 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c Sep 23 12:55:17 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:17 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:17 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-65e03bd1-430c-4fef-8863-e91659da3f0c" returned: 0 in 0.254s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:17 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-65e03bd1-430c-4fef-8863-e91659da3f0c" released by "delete_volume" :: held 0.726s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:17 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] Created reservations ['7fa8b260-b557-4992-a5df-adc381fe52fe', '4504abaf-b714-464f-8e3a-e8bc3a3ba413', '04860949-e91f-49d8-9d3c-b66e57cf5a30', 'c18b2691-ad9d-4721-add2-e7ec4e5bb0e5'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:18 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:55:18 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:18 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.248s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:55:18 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] Deleted volume successfully. Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-574fe06f-3305-4a1a-ae60-3ac03ce95fb0 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-65e03bd1-430c-4fef-8863-e91659da3f0c-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Flow 'volume_create_manager' (6243a35e-0976-4eae-91a5-2a8dc8e4ecf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d31847-2041-4c87-9f9f-c5f78a7d58c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d31847-2041-4c87-9f9f-c5f78a7d58c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2101377372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edcf6999-f6c6-4e56-aeac-5284ce0a2818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fdcd86a5cf44b7bf3afc72ccee4603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:55:19Z,use_quota=True,user_id='399ebb30c0be43a0b1a2458707bca670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9b3ede-2d6c-4b6a-a189-ecc3d80e1e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9b3ede-2d6c-4b6a-a189-ecc3d80e1e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb18c439-6ef0-4b04-bc6e-5dde193194a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb18c439-6ef0-4b04-bc6e-5dde193194a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edcf6999-f6c6-4e56-aeac-5284ce0a2818', 'volume_name': 'volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc444a9-ccd0-4776-8757-fdc8d67a1486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc444a9-ccd0-4776-8757-fdc8d67a1486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c70482d7-f356-4323-b6fd-d6d57dfa4fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:18 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Volume edcf6999-f6c6-4e56-aeac-5284ce0a2818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818', 'volume_size': 1} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2101377372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edcf6999-f6c6-4e56-aeac-5284ce0a2818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fdcd86a5cf44b7bf3afc72ccee4603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:55:19Z,use_quota=True,user_id='399ebb30c0be43a0b1a2458707bca670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Creating volume edcf6999-f6c6-4e56-aeac-5284ce0a2818 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:55:18 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:55:18 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:18 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818 1073741824 Sep 23 12:55:18 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:19 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818 1073741824" returned: 0 in 0.459s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:19 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818 Sep 23 12:55:19 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:19 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818" returned: 0 in 0.242s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:19 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:55:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c70482d7-f356-4323-b6fd-d6d57dfa4fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c46c031-9b34-42d6-930c-c6d1ed4555ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:19 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Volume volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818 (edcf6999-f6c6-4e56-aeac-5284ce0a2818): created successfully Sep 23 12:55:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c46c031-9b34-42d6-930c-c6d1ed4555ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:19 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Flow 'volume_create_manager' (6243a35e-0976-4eae-91a5-2a8dc8e4ecf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:55:19 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-cef4fafb-a3f1-48d6-8ab3-b451c6c20e9a tempest-ProjectMemberTests-1374908563 None] Created volume successfully. Sep 23 12:55:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3d3d0901-c89d-4ad9-8847-b33cb567fa04 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:19 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3d3d0901-c89d-4ad9-8847-b33cb567fa04 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:20 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-3d3d0901-c89d-4ad9-8847-b33cb567fa04 tempest-ProjectMemberTests-1374908563 None] Creating offline snapshot 5358d0cb-e276-47b8-a906-18a93ea5d7ea of volume edcf6999-f6c6-4e56-aeac-5284ce0a2818 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:55:20 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adf8b02-2794-46b9-9587-687770d4cdca]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d3d0901-c89d-4ad9-8847-b33cb567fa04 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:20 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818 Sep 23 12:55:20 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:20 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d3d0901-c89d-4ad9-8847-b33cb567fa04 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818" returned: 0 in 0.393s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d3d0901-c89d-4ad9-8847-b33cb567fa04 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:20 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea 1G Sep 23 12:55:20 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:20 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d3d0901-c89d-4ad9-8847-b33cb567fa04 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea 1G" returned: 0 in 0.449s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:20 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d3d0901-c89d-4ad9-8847-b33cb567fa04 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:20 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea Sep 23 12:55:20 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:21 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d3d0901-c89d-4ad9-8847-b33cb567fa04 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea" returned: 0 in 0.314s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:21 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-3d3d0901-c89d-4ad9-8847-b33cb567fa04 tempest-ProjectMemberTests-1374908563 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea is being set with open permissions: ugo+rw Sep 23 12:55:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d3d0901-c89d-4ad9-8847-b33cb567fa04 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:21 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea Sep 23 12:55:21 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:21 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d3d0901-c89d-4ad9-8847-b33cb567fa04 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea" returned: 0 in 0.257s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d3d0901-c89d-4ad9-8847-b33cb567fa04 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:21 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.info Sep 23 12:55:21 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:21 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d3d0901-c89d-4ad9-8847-b33cb567fa04 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.info" returned: 0 in 0.251s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:21 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-3d3d0901-c89d-4ad9-8847-b33cb567fa04 tempest-ProjectMemberTests-1374908563 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.info is being set with open permissions: ugo+rw Sep 23 12:55:21 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d3d0901-c89d-4ad9-8847-b33cb567fa04 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:21 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.info Sep 23 12:55:21 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:21 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-3d3d0901-c89d-4ad9-8847-b33cb567fa04 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.info" returned: 0 in 0.265s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:22 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-3d3d0901-c89d-4ad9-8847-b33cb567fa04 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.024s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:22 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-3d3d0901-c89d-4ad9-8847-b33cb567fa04 tempest-ProjectMemberTests-1374908563 None] Create snapshot completed successfully Sep 23 12:55:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-5358d0cb-e276-47b8-a906-18a93ea5d7ea-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] Lock "cinder-5358d0cb-e276-47b8-a906-18a93ea5d7ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-edcf6999-f6c6-4e56-aeac-5284ce0a2818" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-edcf6999-f6c6-4e56-aeac-5284ce0a2818" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-5358d0cb-e276-47b8-a906-18a93ea5d7ea" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:23 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-5358d0cb-e276-47b8-a906-18a93ea5d7ea" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] Deleting offline snapshot 5358d0cb-e276-47b8-a906-18a93ea5d7ea of volume edcf6999-f6c6-4e56-aeac-5284ce0a2818 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:55:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] snapshot_file for this snap is: volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:55:23 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d970ed1-9c91-44b1-a358-f82bb30e4da3]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:23 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea Sep 23 12:55:23 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:23 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea" returned: 0 in 0.369s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:23 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:55:23 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e65321-c877-4e4a-8317-351cbe5c75d8]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:23 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:23 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818 Sep 23 12:55:23 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:24 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818" returned: 0 in 0.437s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:24 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea Sep 23 12:55:24 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:24 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea" returned: 0 in 0.376s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:24 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea Sep 23 12:55:24 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:24 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:24 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818.5358d0cb-e276-47b8-a906-18a93ea5d7ea" returned: 0 in 0.248s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-5358d0cb-e276-47b8-a906-18a93ea5d7ea" released by "_delete_snapshot" :: held 1.542s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-edcf6999-f6c6-4e56-aeac-5284ce0a2818" released by "delete_snapshot" :: held 1.566s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:24 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:INSERT=77,cinder:UPDATE=253,cinder:SELECT=199,cinder:DELETE=18 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:55:24 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=196,cinder:INSERT=65,cinder:UPDATE=265,cinder:DELETE=24 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:55:24 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] Created reservations ['8c26b741-6799-4c90-8dc1-b8e79f16db42', 'cac7a7c9-d78e-4abc-ad1e-9e101e137175', '2ed92d47-2a0d-43be-88fe-3d6a1fe2e810', 'a46a6fb1-1dcf-463d-bfc0-7b529148fae1'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:55:24 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] Delete snapshot completed successfully. Sep 23 12:55:24 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-ca0fdd9b-a255-42c6-ba40-f145bf77a53f tempest-ProjectMemberTests-1374908563 None] Lock "cinder-5358d0cb-e276-47b8-a906-18a93ea5d7ea-delete_snapshot" released by "delete_snapshot" :: held 1.750s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-edcf6999-f6c6-4e56-aeac-5284ce0a2818-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-edcf6999-f6c6-4e56-aeac-5284ce0a2818-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-edcf6999-f6c6-4e56-aeac-5284ce0a2818" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:25 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-edcf6999-f6c6-4e56-aeac-5284ce0a2818" acquired by "delete_volume" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:25 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[87840e08-4a24-4c0e-a976-1ba5d849e6eb]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:25 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818 Sep 23 12:55:25 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:25 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818" returned: 0 in 0.418s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:25 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:25 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818 Sep 23 12:55:25 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:26 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-edcf6999-f6c6-4e56-aeac-5284ce0a2818" returned: 0 in 0.261s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-edcf6999-f6c6-4e56-aeac-5284ce0a2818" released by "delete_volume" :: held 0.765s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:26 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] Created reservations ['48759215-559c-4959-b6e1-2ee64f24d00f', 'f8963d96-a5d2-4ff8-9c03-90de031b72e7', '41c1fedb-9775-409e-9970-a254feea2705', '5adf1ebd-4450-4218-aa4d-151e71c41251'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:55:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:55:26 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:55:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:26 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:55:26 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:26 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:26 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.267s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:26 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:55:26 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] Deleted volume successfully. Sep 23 12:55:26 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-98950bf8-42ee-4c79-a451-3ea91e444551 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-edcf6999-f6c6-4e56-aeac-5284ce0a2818-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Flow 'volume_create_manager' (7921de06-e82b-4519-a144-1cae63f728a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad7bf46-ff82-40c0-ae68-2744d625609e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad7bf46-ff82-40c0-ae68-2744d625609e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2101106464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487b0168-bbd8-49f6-be7d-61ea49382656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fdcd86a5cf44b7bf3afc72ccee4603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:55:27Z,use_quota=True,user_id='399ebb30c0be43a0b1a2458707bca670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f13a6499-1652-4fb3-a6f2-37bbd5f580dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f13a6499-1652-4fb3-a6f2-37bbd5f580dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943b5b08-ac18-416e-b7e3-6caafb02c21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943b5b08-ac18-416e-b7e3-6caafb02c21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '487b0168-bbd8-49f6-be7d-61ea49382656', 'volume_name': 'volume-487b0168-bbd8-49f6-be7d-61ea49382656', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2ab7cff-9e45-468b-a73d-8baa3e791374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2ab7cff-9e45-468b-a73d-8baa3e791374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd048d10-abac-42ce-854a-edbbb7c9803c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:27 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Volume 487b0168-bbd8-49f6-be7d-61ea49382656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-487b0168-bbd8-49f6-be7d-61ea49382656', 'volume_size': 1} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2101106464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487b0168-bbd8-49f6-be7d-61ea49382656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fdcd86a5cf44b7bf3afc72ccee4603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:55:27Z,use_quota=True,user_id='399ebb30c0be43a0b1a2458707bca670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Creating volume 487b0168-bbd8-49f6-be7d-61ea49382656 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:55:27 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:27 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656 1073741824 Sep 23 12:55:27 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:27 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656 1073741824" returned: 0 in 0.456s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:27 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656 Sep 23 12:55:27 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:27 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656" returned: 0 in 0.250s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd048d10-abac-42ce-854a-edbbb7c9803c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-487b0168-bbd8-49f6-be7d-61ea49382656', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12078b0-ae5a-4a51-80ca-13ea23b3e6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:27 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Volume volume-487b0168-bbd8-49f6-be7d-61ea49382656 (487b0168-bbd8-49f6-be7d-61ea49382656): created successfully Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12078b0-ae5a-4a51-80ca-13ea23b3e6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:27 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Flow 'volume_create_manager' (7921de06-e82b-4519-a144-1cae63f728a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:55:27 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-071ecfac-f03b-4382-9132-ed35deef892f tempest-ProjectMemberTests-1374908563 None] Created volume successfully. Sep 23 12:55:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5974dff3-f75e-4532-8416-0c4747f61b95 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5974dff3-f75e-4532-8416-0c4747f61b95 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:28 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-5974dff3-f75e-4532-8416-0c4747f61b95 tempest-ProjectMemberTests-1374908563 None] Creating offline snapshot 5b89edad-ac95-4262-941c-df178dc901b7 of volume 487b0168-bbd8-49f6-be7d-61ea49382656 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:55:28 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a1757f-609a-41f8-976d-14b8cfbdd04b]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5974dff3-f75e-4532-8416-0c4747f61b95 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:28 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656 Sep 23 12:55:28 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:28 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5974dff3-f75e-4532-8416-0c4747f61b95 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656" returned: 0 in 0.410s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:28 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5974dff3-f75e-4532-8416-0c4747f61b95 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:28 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7 1G Sep 23 12:55:28 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:29 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5974dff3-f75e-4532-8416-0c4747f61b95 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7 1G" returned: 0 in 0.413s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5974dff3-f75e-4532-8416-0c4747f61b95 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487b0168-bbd8-49f6-be7d-61ea49382656 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:29 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487b0168-bbd8-49f6-be7d-61ea49382656 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7 Sep 23 12:55:29 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:29 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5974dff3-f75e-4532-8416-0c4747f61b95 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487b0168-bbd8-49f6-be7d-61ea49382656 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7" returned: 0 in 0.292s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:29 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-5974dff3-f75e-4532-8416-0c4747f61b95 tempest-ProjectMemberTests-1374908563 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7 is being set with open permissions: ugo+rw Sep 23 12:55:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5974dff3-f75e-4532-8416-0c4747f61b95 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:29 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7 Sep 23 12:55:29 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:29 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5974dff3-f75e-4532-8416-0c4747f61b95 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7" returned: 0 in 0.247s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:29 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5974dff3-f75e-4532-8416-0c4747f61b95 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:29 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.info Sep 23 12:55:29 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:30 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5974dff3-f75e-4532-8416-0c4747f61b95 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.info" returned: 0 in 0.263s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:30 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-5974dff3-f75e-4532-8416-0c4747f61b95 tempest-ProjectMemberTests-1374908563 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.info is being set with open permissions: ugo+rw Sep 23 12:55:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5974dff3-f75e-4532-8416-0c4747f61b95 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:30 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.info Sep 23 12:55:30 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:30 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-5974dff3-f75e-4532-8416-0c4747f61b95 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.info" returned: 0 in 0.254s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:30 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-5974dff3-f75e-4532-8416-0c4747f61b95 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:30 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-5974dff3-f75e-4532-8416-0c4747f61b95 tempest-ProjectMemberTests-1374908563 None] Create snapshot completed successfully Sep 23 12:55:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-5b89edad-ac95-4262-941c-df178dc901b7-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-5b89edad-ac95-4262-941c-df178dc901b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-487b0168-bbd8-49f6-be7d-61ea49382656" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-487b0168-bbd8-49f6-be7d-61ea49382656" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-5b89edad-ac95-4262-941c-df178dc901b7" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:31 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-5b89edad-ac95-4262-941c-df178dc901b7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:31 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] Deleting offline snapshot 5b89edad-ac95-4262-941c-df178dc901b7 of volume 487b0168-bbd8-49f6-be7d-61ea49382656 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:55:31 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] snapshot_file for this snap is: volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:55:31 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ce089b-05a6-40ab-b88e-6e1a2916233b]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:31 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:31 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7 Sep 23 12:55:31 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:32 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7" returned: 0 in 0.364s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:32 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-487b0168-bbd8-49f6-be7d-61ea49382656(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:55:32 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e0e800-0fd3-4441-ac46-adab409203c5]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:32 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656 Sep 23 12:55:32 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:32 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656" returned: 0 in 0.392s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:32 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7 Sep 23 12:55:32 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:32 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7" returned: 0 in 0.359s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:32 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:32 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7 Sep 23 12:55:32 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:33 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656.5b89edad-ac95-4262-941c-df178dc901b7" returned: 0 in 0.240s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-5b89edad-ac95-4262-941c-df178dc901b7" released by "_delete_snapshot" :: held 1.456s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-487b0168-bbd8-49f6-be7d-61ea49382656" released by "delete_snapshot" :: held 1.477s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:33 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] Created reservations ['aa57d20b-b229-4f33-8a36-efab5fe03457', '6ca1e2de-4b51-4909-b3ff-6ffb9ad6c29b', 'b27c3d74-930e-4bd8-b2b3-d4598fa227af', '80b1c176-1587-408f-a70e-fb3b76ccfcbf'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:55:33 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] Delete snapshot completed successfully. Sep 23 12:55:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6be259ba-fba1-42a3-abf4-3826ca2b1c73 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-5b89edad-ac95-4262-941c-df178dc901b7-delete_snapshot" released by "delete_snapshot" :: held 1.636s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-487b0168-bbd8-49f6-be7d-61ea49382656-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-487b0168-bbd8-49f6-be7d-61ea49382656-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "cinder-quobyte-487b0168-bbd8-49f6-be7d-61ea49382656" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:33 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-487b0168-bbd8-49f6-be7d-61ea49382656" acquired by "delete_volume" :: waited 0.020s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:33 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[05375d37-15c0-4065-8db6-17398d1466b0]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:33 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:34 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656 Sep 23 12:55:34 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:34 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656" returned: 0 in 0.417s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:34 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656 Sep 23 12:55:34 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:34 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-487b0168-bbd8-49f6-be7d-61ea49382656" returned: 0 in 0.304s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:34 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-quobyte-487b0168-bbd8-49f6-be7d-61ea49382656" released by "delete_volume" :: held 0.803s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:34 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] Created reservations ['9e7bceaf-252b-453e-864f-6d2ec3a3313e', '5bdecdb7-c42e-4ded-88d3-947ca0c0e20c', '60aaacaa-b506-4286-abe9-c2b00964ba90', 'f193a280-ec19-4b7c-89e0-1aec57163f87'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:55:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:55:34 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:55:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:34 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:34 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:55:34 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:35 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:35 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.307s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:35 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:55:35 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] Deleted volume successfully. Sep 23 12:55:35 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6ed9e06a-5956-4458-9a97-77f9a194dd35 tempest-ProjectMemberTests-1374908563 None] Lock "cinder-487b0168-bbd8-49f6-be7d-61ea49382656-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Flow 'volume_create_manager' (6addfa99-fd5a-411f-a836-008519018320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd8eab8-d7fa-4e1a-a186-bb5722d3b511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd8eab8-d7fa-4e1a-a186-bb5722d3b511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1470722316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67bf3c23-5973-4a43-8a2e-d483ff34afc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='192b1bbd1d8f405c93f3b555ae9d7978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:55:38Z,use_quota=True,user_id='c085e9100c4e4b7b8a6ccaaa4c7bf536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac0f203-3921-4ed8-b066-353f14496122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac0f203-3921-4ed8-b066-353f14496122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6747ab1-062c-4e41-887f-262918c8af77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6747ab1-062c-4e41-887f-262918c8af77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67bf3c23-5973-4a43-8a2e-d483ff34afc0', 'volume_name': 'volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022c0e04-1bac-4ea0-aec6-9bf52d19d4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022c0e04-1bac-4ea0-aec6-9bf52d19d4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df2d711-da7c-45d4-859a-c53915f43443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:38 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Volume 67bf3c23-5973-4a43-8a2e-d483ff34afc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0', 'volume_size': 1} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1470722316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67bf3c23-5973-4a43-8a2e-d483ff34afc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='192b1bbd1d8f405c93f3b555ae9d7978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:55:38Z,use_quota=True,user_id='c085e9100c4e4b7b8a6ccaaa4c7bf536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)}" {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Creating volume 67bf3c23-5973-4a43-8a2e-d483ff34afc0 {{(pid=86085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:55:38 devstack cinder-volume[86085]: INFO cinder.volume.drivers.remotefs [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] casted to osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 Sep 23 12:55:38 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 1073741824 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:38 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 1073741824 Sep 23 12:55:38 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:39 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 1073741824" returned: 0 in 0.468s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:39 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 Sep 23 12:55:39 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:39 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0" returned: 0 in 0.261s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:39 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'} {{(pid=86085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 12:55:39 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df2d711-da7c-45d4-859a-c53915f43443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0', 'volume_size': 1}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1aae18-2885-4d49-9d56-2f9bdfed55ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:39 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Volume volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 (67bf3c23-5973-4a43-8a2e-d483ff34afc0): created successfully Sep 23 12:55:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1aae18-2885-4d49-9d56-2f9bdfed55ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:39 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Flow 'volume_create_manager' (6addfa99-fd5a-411f-a836-008519018320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:55:39 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-7be494f0-7b4d-453c-be75-fe985e5e082f tempest-SnapshotDependencyTests-1551808640 None] Created volume successfully. Sep 23 12:55:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-886f5246-3f71-4081-bede-5c198c1c62d9 tempest-SnapshotDependencyTests-1551808640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-886f5246-3f71-4081-bede-5c198c1c62d9 tempest-SnapshotDependencyTests-1551808640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:40 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-886f5246-3f71-4081-bede-5c198c1c62d9 tempest-SnapshotDependencyTests-1551808640 None] Creating offline snapshot f7956216-7910-4e34-9167-f2b644f5e1cd of volume 67bf3c23-5973-4a43-8a2e-d483ff34afc0 {{(pid=86085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 12:55:40 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a8b7e7-a2be-40a6-9db0-36e44e5c5ad0]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:40 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-886f5246-3f71-4081-bede-5c198c1c62d9 tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:40 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 Sep 23 12:55:40 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:41 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-886f5246-3f71-4081-bede-5c198c1c62d9 tempest-SnapshotDependencyTests-1551808640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0" returned: 0 in 0.373s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-886f5246-3f71-4081-bede-5c198c1c62d9 tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd 1G {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:41 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd 1G Sep 23 12:55:41 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:55:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:55:41 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:55:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:41 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:55:41 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:41 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-886f5246-3f71-4081-bede-5c198c1c62d9 tempest-SnapshotDependencyTests-1551808640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd 1G" returned: 0 in 0.422s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-886f5246-3f71-4081-bede-5c198c1c62d9 tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:41 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd Sep 23 12:55:41 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:41 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.266s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:41 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:55:41 devstack cinder-volume[86085]: DEBUG oslo_service.periodic_task [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 12:55:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread count: 28 {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 12:55:41 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-98a7aac3-999d-401c-8e74-7a1dd871cdb4 None None] thread info: [<_MainThread(MainThread, started 124093583331456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 12:55:41 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-886f5246-3f71-4081-bede-5c198c1c62d9 tempest-SnapshotDependencyTests-1551808640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 -F qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd" returned: 0 in 0.313s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:41 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-886f5246-3f71-4081-bede-5c198c1c62d9 tempest-SnapshotDependencyTests-1551808640 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd is being set with open permissions: ugo+rw Sep 23 12:55:41 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-886f5246-3f71-4081-bede-5c198c1c62d9 tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:41 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd Sep 23 12:55:41 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:42 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-886f5246-3f71-4081-bede-5c198c1c62d9 tempest-SnapshotDependencyTests-1551808640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd" returned: 0 in 0.227s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-886f5246-3f71-4081-bede-5c198c1c62d9 tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:42 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.info Sep 23 12:55:42 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:42 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-886f5246-3f71-4081-bede-5c198c1c62d9 tempest-SnapshotDependencyTests-1551808640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.info" returned: 0 in 0.245s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:42 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-886f5246-3f71-4081-bede-5c198c1c62d9 tempest-SnapshotDependencyTests-1551808640 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.info is being set with open permissions: ugo+rw Sep 23 12:55:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-886f5246-3f71-4081-bede-5c198c1c62d9 tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.info {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:42 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.info Sep 23 12:55:42 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:42 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-886f5246-3f71-4081-bede-5c198c1c62d9 tempest-SnapshotDependencyTests-1551808640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.info" returned: 0 in 0.241s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:42 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-886f5246-3f71-4081-bede-5c198c1c62d9 tempest-SnapshotDependencyTests-1551808640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.913s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:42 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-886f5246-3f71-4081-bede-5c198c1c62d9 tempest-SnapshotDependencyTests-1551808640 None] Create snapshot completed successfully Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.volume.flows.manager.create_volume [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Flow 'volume_create_manager' (b10c9cf3-1b8d-4d76-9156-6f565193a617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc47571-9513-4a84-850f-9bbb0da7f908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc47571-9513-4a84-850f-9bbb0da7f908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T10:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b9f263-e879-4fe7-8c11-0521e98fb312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='192b1bbd1d8f405c93f3b555ae9d7978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T10:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f7956216-7910-4e34-9167-f2b644f5e1cd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T10:55:43Z,use_quota=True,user_id='c085e9100c4e4b7b8a6ccaaa4c7bf536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(665d1353-15ca-4184-b5f2-7239c054c465),volume_type_id=665d1353-15ca-4184-b5f2-7239c054c465)' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711517a8-9a3d-4116-85e2-513910e72b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711517a8-9a3d-4116-85e2-513910e72b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53e8591-755c-4b06-a889-c77974062d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53e8591-755c-4b06-a889-c77974062d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '25b9f263-e879-4fe7-8c11-0521e98fb312', 'volume_name': 'volume-25b9f263-e879-4fe7-8c11-0521e98fb312', 'volume_size': 1, 'snapshot_id': 'f7956216-7910-4e34-9167-f2b644f5e1cd'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2aa0780-8398-46b7-95e3-f195a64f54ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2aa0780-8398-46b7-95e3-f195a64f54ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d9efc6-80b1-40c6-bc86-b12e2257dd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:43 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Volume 25b9f263-e879-4fe7-8c11-0521e98fb312: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-25b9f263-e879-4fe7-8c11-0521e98fb312', 'volume_size': 1, 'snapshot_id': 'f7956216-7910-4e34-9167-f2b644f5e1cd'} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Acquiring lock "cinder-quobyte-f7956216-7910-4e34-9167-f2b644f5e1cd-25b9f263-e879-4fe7-8c11-0521e98fb312" by "_create_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Lock "cinder-quobyte-f7956216-7910-4e34-9167-f2b644f5e1cd-25b9f263-e879-4fe7-8c11-0521e98fb312" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Creating volume 25b9f263-e879-4fe7-8c11-0521e98fb312 from snapshot f7956216-7910-4e34-9167-f2b644f5e1cd {{(pid=86085) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Selected osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68 as target Quobyte volume. {{(pid=86085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Acquiring lock "cinder-quobyte-25b9f263-e879-4fe7-8c11-0521e98fb312" by "_copy_volume_from_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Lock "cinder-quobyte-25b9f263-e879-4fe7-8c11-0521e98fb312" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] snapshot: f7956216-7910-4e34-9167-f2b644f5e1cd, volume: 25b9f263-e879-4fe7-8c11-0521e98fb312, {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f40977-fbf2-4692-916b-8245694e8a07]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:43 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd Sep 23 12:55:43 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:43 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd" returned: 0 in 0.373s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:43 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:55:44 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72c8258-6b12-4e12-990a-27b3c258f1a2]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:44 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 Sep 23 12:55:44 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:44 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0" returned: 0 in 0.376s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:44 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] will copy from snapshot at /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 12:55:44 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Creating direct copy from snapshot {{(pid=86085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 12:55:44 devstack cinder-volume[86085]: DEBUG cinder.utils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Path /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-25b9f263-e879-4fe7-8c11-0521e98fb312 not found in is_blk_device check {{(pid=86085) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 12:55:44 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-25b9f263-e879-4fe7-8c11-0521e98fb312 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:44 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-25b9f263-e879-4fe7-8c11-0521e98fb312 Sep 23 12:55:44 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:50 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-25b9f263-e879-4fe7-8c11-0521e98fb312" returned: 0 in 5.638s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:50 devstack cinder-volume[86085]: DEBUG cinder.image.image_utils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Image conversion details: src /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-25b9f263-e879-4fe7-8c11-0521e98fb312 {{(pid=86085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 12:55:50 devstack cinder-volume[86085]: INFO cinder.image.image_utils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Converted 1024.00 MB image at 181.59 MB/s Sep 23 12:55:50 devstack cinder-volume[86085]: WARNING cinder.volume.drivers.remotefs [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-25b9f263-e879-4fe7-8c11-0521e98fb312 is being set with open permissions: ugo+rw Sep 23 12:55:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-25b9f263-e879-4fe7-8c11-0521e98fb312 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:50 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-25b9f263-e879-4fe7-8c11-0521e98fb312 Sep 23 12:55:50 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:50 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-25b9f263-e879-4fe7-8c11-0521e98fb312" returned: 0 in 0.251s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Lock "cinder-quobyte-25b9f263-e879-4fe7-8c11-0521e98fb312" released by "_copy_volume_from_snapshot" :: held 6.740s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:50 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Lock "cinder-quobyte-f7956216-7910-4e34-9167-f2b644f5e1cd-25b9f263-e879-4fe7-8c11-0521e98fb312" released by "_create_volume_from_snapshot" :: held 6.803s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:50 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.820s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d9efc6-80b1-40c6-bc86-b12e2257dd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b9f263-e879-4fe7-8c11-0521e98fb312', 'volume_size': 1, 'snapshot_id': 'f7956216-7910-4e34-9167-f2b644f5e1cd'}' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcaec88-7808-4660-8843-4b8cfd9cc7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 12:55:50 devstack cinder-volume[86085]: INFO cinder.volume.flows.manager.create_volume [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Volume volume-25b9f263-e879-4fe7-8c11-0521e98fb312 (25b9f263-e879-4fe7-8c11-0521e98fb312): created successfully Sep 23 12:55:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcaec88-7808-4660-8843-4b8cfd9cc7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 12:55:50 devstack cinder-volume[86085]: DEBUG cinder.volume.manager [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Flow 'volume_create_manager' (b10c9cf3-1b8d-4d76-9156-6f565193a617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 12:55:50 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-937c192d-1ce8-4c1d-873a-19e648c42649 tempest-SnapshotDependencyTests-1551808640 None] Created volume successfully. Sep 23 12:55:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] Acquiring lock "cinder-f7956216-7910-4e34-9167-f2b644f5e1cd-delete_snapshot" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] Lock "cinder-f7956216-7910-4e34-9167-f2b644f5e1cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] Acquiring lock "cinder-quobyte-67bf3c23-5973-4a43-8a2e-d483ff34afc0" by "delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] Lock "cinder-quobyte-67bf3c23-5973-4a43-8a2e-d483ff34afc0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] Acquiring lock "cinder-quobyte-f7956216-7910-4e34-9167-f2b644f5e1cd" by "_delete_snapshot" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:51 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] Lock "cinder-quobyte-f7956216-7910-4e34-9167-f2b644f5e1cd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] Deleting offline snapshot f7956216-7910-4e34-9167-f2b644f5e1cd of volume 67bf3c23-5973-4a43-8a2e-d483ff34afc0 {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 12:55:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] snapshot_file for this snap is: volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd {{(pid=86085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 12:55:51 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[605d1ae9-60da-44ca-ac8d-bfb3abda2168]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:51 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd Sep 23 12:55:51 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:51 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd" returned: 0 in 0.382s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:51 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.remotefs [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 12:55:51 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2326f4b4-048c-4924-968b-7cc196868961]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:51 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:51 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 Sep 23 12:55:51 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:52 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0" returned: 0 in 0.528s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:52 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd Sep 23 12:55:52 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:52 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd" returned: 0 in 0.318s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:52 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd Sep 23 12:55:52 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:52 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:52 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0.f7956216-7910-4e34-9167-f2b644f5e1cd" returned: 0 in 0.256s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] Lock "cinder-quobyte-f7956216-7910-4e34-9167-f2b644f5e1cd" released by "_delete_snapshot" :: held 1.599s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] Lock "cinder-quobyte-67bf3c23-5973-4a43-8a2e-d483ff34afc0" released by "delete_snapshot" :: held 1.629s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:52 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] Created reservations ['4da2be86-c10c-49ab-a6f1-64bdd8fc7502', '41fdc74f-22db-49f9-b45b-0bc6713f1712', 'ae89d5c8-c257-41d1-bbe4-9bff4d4b3363', 'cc1017a8-2d75-4e35-ab22-f190f701124c'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:55:52 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] Delete snapshot completed successfully. Sep 23 12:55:52 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-6152ed06-acbd-4c5f-a7a5-168fdaa5b6cd tempest-SnapshotDependencyTests-1551808640 None] Lock "cinder-f7956216-7910-4e34-9167-f2b644f5e1cd-delete_snapshot" released by "delete_snapshot" :: held 1.767s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] Acquiring lock "cinder-67bf3c23-5973-4a43-8a2e-d483ff34afc0-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] Lock "cinder-67bf3c23-5973-4a43-8a2e-d483ff34afc0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] Acquiring lock "cinder-quobyte-67bf3c23-5973-4a43-8a2e-d483ff34afc0" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] Lock "cinder-quobyte-67bf3c23-5973-4a43-8a2e-d483ff34afc0" acquired by "delete_volume" :: waited 0.014s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:53 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb728730-5a8d-4624-99c8-ffe9a42fd352]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:53 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 Sep 23 12:55:53 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:53 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0" returned: 0 in 0.362s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:53 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0 Sep 23 12:55:53 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:53 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:53 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-67bf3c23-5973-4a43-8a2e-d483ff34afc0" returned: 0 in 0.251s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:53 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] Lock "cinder-quobyte-67bf3c23-5973-4a43-8a2e-d483ff34afc0" released by "delete_volume" :: held 0.674s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:53 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] Created reservations ['86916b3c-77aa-4f84-ad9b-907775e7e5a7', '08d78b90-9ce9-4628-be3e-e70d4dfbd2a5', '283e02b1-74f9-4c7f-a082-c9a43e0d400e', '19ab665f-d00a-4c7c-b494-9f769d3213eb'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:55:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:55:54 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:55:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:54 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:55:54 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:54 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.244s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:54 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:55:54 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] Deleted volume successfully. Sep 23 12:55:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-0133097f-2e3f-42ed-b8b3-79a785590c71 tempest-SnapshotDependencyTests-1551808640 None] Lock "cinder-67bf3c23-5973-4a43-8a2e-d483ff34afc0-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] Acquiring lock "cinder-25b9f263-e879-4fe7-8c11-0521e98fb312-delete_volume" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] Lock "cinder-25b9f263-e879-4fe7-8c11-0521e98fb312-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] Acquiring lock "cinder-quobyte-25b9f263-e879-4fe7-8c11-0521e98fb312" by "delete_volume" {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 12:55:54 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] Lock "cinder-quobyte-25b9f263-e879-4fe7-8c11-0521e98fb312" acquired by "delete_volume" :: waited 0.013s {{(pid=86085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 12:55:54 devstack cinder-volume[86085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4335d6-7cfc-430e-b261-d94d174ddc5e]: (4, 'qcow2') {{(pid=87649) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 12:55:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-25b9f263-e879-4fe7-8c11-0521e98fb312 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:54 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-25b9f263-e879-4fe7-8c11-0521e98fb312 Sep 23 12:55:54 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:54 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-25b9f263-e879-4fe7-8c11-0521e98fb312" returned: 0 in 0.357s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:54 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-25b9f263-e879-4fe7-8c11-0521e98fb312 {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:54 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-25b9f263-e879-4fe7-8c11-0521e98fb312 Sep 23 12:55:54 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:55 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d/volume-25b9f263-e879-4fe7-8c11-0521e98fb312" returned: 0 in 0.248s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:55 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] Lock "cinder-quobyte-25b9f263-e879-4fe7-8c11-0521e98fb312" released by "delete_volume" :: held 0.645s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:55:55 devstack cinder-volume[86085]: DEBUG cinder.quota [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] Created reservations ['eb6289d8-e42b-4734-abbb-c46170b10f0e', '66269096-3a2c-4e05-af6c-d90f5cc78e66', '6aea9425-a1a4-45ae-9111-e38977e53ae8', 'a7d42724-4329-4ab3-858a-28ea419bf4ee'] {{(pid=86085) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 12:55:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 12:55:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 12:55:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68': None} {{(pid=86085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 12:55:55 devstack cinder-volume[86085]: DEBUG cinder.volume.drivers.quobyte [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bca07b53-aad0-4a0c-ab2b-703467641d68'] {{(pid=86085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 12:55:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.lockutils [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 12:55:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 12:55:55 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d Sep 23 12:55:55 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 12:55:55 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 23 12:55:55 devstack cinder-volume[86085]: DEBUG oslo_concurrency.processutils [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/87e66a9d83c17cd44ed4765c38ffe16d" returned: 0 in 0.237s {{(pid=86085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 12:55:55 devstack cinder-volume[86085]: DEBUG cinder.manager [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] Notifying Schedulers of capabilities ... {{(pid=86085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 12:55:55 devstack cinder-volume[86085]: INFO cinder.volume.manager [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] Deleted volume successfully. Sep 23 12:55:55 devstack cinder-volume[86085]: DEBUG cinder.coordination [None req-e8228b2b-b111-4104-abc9-0166687e860c tempest-SnapshotDependencyTests-1551808640 None] Lock "cinder-25b9f263-e879-4fe7-8c11-0521e98fb312-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=86085) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 12:56:05 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:SELECT=49,cinder:INSERT=20,cinder:UPDATE=69,cinder:DELETE=3 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 12:56:05 devstack cinder-volume[86085]: DEBUG dbcounter [-] [86085] Writing DB stats cinder:INSERT=13,cinder:UPDATE=52,cinder:SELECT=45,cinder:DELETE=6 {{(pid=86085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}